-- Logs begin at Tue 2022-08-09 06:20:09 UTC, end at Tue 2022-08-09 07:28:59 UTC. -- Aug 09 06:54:19.309584 dv-cinder-852514-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 09 06:54:19.318470 dv-cinder-852514-1-iscsi devstack@n-api.service[103146]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 09 06:54:19.320486 dv-cinder-852514-1-iscsi devstack@n-api.service[103146]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 9 06:54:19 2022] *** Aug 09 06:54:19.320486 dv-cinder-852514-1-iscsi devstack@n-api.service[103146]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 09 06:54:19.320486 dv-cinder-852514-1-iscsi devstack@n-api.service[103146]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 09 06:54:19.320486 dv-cinder-852514-1-iscsi devstack@n-api.service[103146]: nodename: dv-cinder-852514-1-iscsi Aug 09 06:54:19.320486 dv-cinder-852514-1-iscsi devstack@n-api.service[103146]: machine: x86_64 Aug 09 06:54:19.320486 dv-cinder-852514-1-iscsi devstack@n-api.service[103146]: clock source: unix Aug 09 06:54:19.320486 dv-cinder-852514-1-iscsi devstack@n-api.service[103146]: pcre jit disabled Aug 09 06:54:19.320486 dv-cinder-852514-1-iscsi devstack@n-api.service[103146]: detected number of CPU cores: 4 Aug 09 06:54:19.320486 dv-cinder-852514-1-iscsi devstack@n-api.service[103146]: current working directory: / Aug 09 06:54:19.320486 dv-cinder-852514-1-iscsi devstack@n-api.service[103146]: detected binary path: /usr/bin/uwsgi-core Aug 09 06:54:19.321176 dv-cinder-852514-1-iscsi devstack@n-api.service[103146]: your processes number limit is 47680 Aug 09 06:54:19.321176 dv-cinder-852514-1-iscsi devstack@n-api.service[103146]: your memory page size is 4096 bytes Aug 09 06:54:19.321176 dv-cinder-852514-1-iscsi devstack@n-api.service[103146]: detected max file descriptor number: 2048 Aug 09 06:54:19.321176 dv-cinder-852514-1-iscsi devstack@n-api.service[103146]: lock engine: pthread robust mutexes Aug 09 06:54:19.321176 dv-cinder-852514-1-iscsi devstack@n-api.service[103146]: thunder lock: enabled Aug 09 06:54:19.321176 dv-cinder-852514-1-iscsi devstack@n-api.service[103146]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 09 06:54:19.321176 dv-cinder-852514-1-iscsi devstack@n-api.service[103146]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 09 06:54:19.360628 dv-cinder-852514-1-iscsi devstack@n-api.service[103146]: Python main interpreter initialized at 0x5587d76349c0 Aug 09 06:54:19.360628 dv-cinder-852514-1-iscsi devstack@n-api.service[103146]: python threads support enabled Aug 09 06:54:19.360628 dv-cinder-852514-1-iscsi devstack@n-api.service[103146]: your server socket listen backlog is limited to 100 connections Aug 09 06:54:19.360628 dv-cinder-852514-1-iscsi devstack@n-api.service[103146]: your mercy for graceful operations on workers is 90 seconds Aug 09 06:54:19.360955 dv-cinder-852514-1-iscsi devstack@n-api.service[103146]: mapped 403077 bytes (393 KB) for 2 cores Aug 09 06:54:19.361029 dv-cinder-852514-1-iscsi devstack@n-api.service[103146]: *** Operational MODE: preforking *** Aug 09 06:54:19.361285 dv-cinder-852514-1-iscsi devstack@n-api.service[103146]: *** uWSGI is running in multiple interpreter mode *** Aug 09 06:54:19.361285 dv-cinder-852514-1-iscsi devstack@n-api.service[103146]: spawned uWSGI master process (pid: 103146) Aug 09 06:54:19.361465 dv-cinder-852514-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 09 06:54:19.363649 dv-cinder-852514-1-iscsi devstack@n-api.service[103146]: spawned uWSGI worker 1 (pid: 103147, cores: 1) Aug 09 06:54:19.363649 dv-cinder-852514-1-iscsi devstack@n-api.service[103146]: spawned uWSGI worker 2 (pid: 103148, cores: 1) Aug 09 06:54:19.363649 dv-cinder-852514-1-iscsi devstack@n-api.service[103146]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 09 06:54:20.034848 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 09 06:54:20.035437 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 09 06:54:21.122881 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 06:54:21.122881 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: from cryptography.utils import int_from_bytes Aug 09 06:54:21.123465 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 06:54:21.123465 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: from cryptography.utils import int_from_bytes Aug 09 06:54:21.123465 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 06:54:21.123465 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: from cryptography.utils import int_from_bytes Aug 09 06:54:21.123967 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 06:54:21.123967 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: from cryptography.utils import int_from_bytes Aug 09 06:54:23.628984 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 06:54:23.629567 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 06:54:23.629752 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 06:54:23.630034 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 06:54:23.630400 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 06:54:23.630501 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 06:54:23.630596 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 06:54:23.630721 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.630817 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 06:54:23.631046 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.631144 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 06:54:23.631367 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.631459 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 06:54:23.631713 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.631814 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.632045 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.632138 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.632357 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.632446 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.632677 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.632769 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.632993 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.633082 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.633321 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.633415 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.633582 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.633678 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.633895 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.633984 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.634218 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852514-1-iscsi {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.634307 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.634522 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.634683 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.634839 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.634983 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.635146 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.635277 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852514-1-iscsi {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.635464 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.635614 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.635793 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.635958 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.636087 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.636217 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.636408 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.636539 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.636716 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.636903 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.637334 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.637334 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.637563 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.637700 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.637805 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.637927 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.638126 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.638254 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.638434 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.638571 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.638740 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.638927 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.639075 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.639206 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.639376 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.639510 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.639712 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.639837 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.640033 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.640233 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.640381 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.640584 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852514-1-iscsi {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.640731 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.640943 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.641100 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.641304 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.641452 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.641661 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852514-1-iscsi {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.641850 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.641996 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.642200 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.642382 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.642682 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.642841 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.642841 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.643138 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.643302 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.643437 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.643557 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.643731 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.643857 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.643976 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.644105 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.644234 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.644392 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.644515 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.644641 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.644769 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.644898 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.645020 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.645139 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.645259 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.645422 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.645559 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.645740 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.645875 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.646051 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.646183 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.646357 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.646496 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.646618 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.646738 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.646901 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.647025 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.647223 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.647360 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.647544 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.647698 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.647880 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.648009 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.648146 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.648278 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.648524 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.648661 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.648788 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.648908 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.649046 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.649173 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.649294 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.649414 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.649565 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.649709 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.649875 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.649998 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.650181 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.650311 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.650488 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.650624 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.650796 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.650917 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.651099 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.651230 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.651405 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.651540 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.651737 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.651861 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.652048 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.652171 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.652356 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.652486 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.652661 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.652781 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.652980 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.653100 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.653308 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.653432 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.653607 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.653736 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.653914 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.654036 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.654249 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.654372 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.654545 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.654668 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.654854 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.654977 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.655170 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.655297 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.655488 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.655637 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.655824 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.655960 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.656121 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.656256 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.656424 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.656567 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.656821 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.656992 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.657243 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.657374 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.657497 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.657622 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.657750 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.657926 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.658050 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.658263 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.658392 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.658626 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.658760 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.658891 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.659023 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.659176 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.659300 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.659484 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.659735 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.659861 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.659995 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.660124 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.660255 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.660398 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.660536 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.660705 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.660835 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.661011 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.661135 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.661317 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.661454 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.661622 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.661753 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.661928 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.662059 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.662230 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.662364 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.662534 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.662665 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.662837 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.662966 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.663152 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.663276 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.663455 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.663578 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.663786 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.663918 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.664094 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.664229 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.664401 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.664542 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.664709 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.664842 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.665014 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.665145 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.665320 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.665448 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.665627 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.665750 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.665937 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.666069 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.666242 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.666374 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.666550 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.666679 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.666878 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.667006 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.667140 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.667262 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.667450 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.667581 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.667773 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.667895 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.668071 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.668202 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.668385 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.668508 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.668769 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.668909 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.669037 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.669165 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.669286 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.669408 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.669565 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.669697 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.669869 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.669994 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.670174 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.670311 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.670476 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.670599 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.670777 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.670907 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.671078 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.671210 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.671384 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.671514 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.671714 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.671849 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.672022 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.672688 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.672899 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.673029 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.673199 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.673323 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.673524 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.673658 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.673837 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.673959 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.674142 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.674274 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.674452 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.674578 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.674774 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 06:54:23.674903 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.675113 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.675244 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.675450 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.675575 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.675813 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.675934 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.676131 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.676270 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.676451 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.676575 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.676779 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.676901 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.677095 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.677229 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.677408 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.677530 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.677719 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.677848 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.678040 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.678171 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.678353 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.678481 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.678669 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.678792 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.678990 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.679137 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.679275 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.679404 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.679608 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.679735 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.679930 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.680064 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.680252 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.680386 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.680569 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.680692 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.680891 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.681021 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.681205 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.681336 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.681525 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.681647 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.681861 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.682004 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.682181 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.682309 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.682495 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.682618 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.682815 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.682956 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.683127 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.683251 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.683440 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.683564 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.683777 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.683912 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.684101 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.684232 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.684433 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.684555 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.684744 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.684868 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.685054 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.685178 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.685366 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.685488 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.685680 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.685814 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.685990 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.686115 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.686306 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.686431 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.686621 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.686751 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.686938 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.687074 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.687253 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.687389 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.687567 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.687716 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.688480 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.688615 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.688823 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.689140 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.689269 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.689390 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.689517 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.689645 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.689766 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.689898 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.690019 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.690139 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.690280 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.690404 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.690562 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.690762 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.690887 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.691020 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.691165 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.691296 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.691486 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.691677 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.691838 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.691963 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.692147 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.692271 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.692455 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.692579 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.692773 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.692896 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.693085 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.693209 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.693396 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.693522 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.693707 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.693831 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.694012 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.694143 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.694323 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.694448 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.694635 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.694757 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.694939 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.695061 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.695247 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.695377 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.695563 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.695710 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.695892 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.696025 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.696198 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.696327 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.696514 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.696644 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.696820 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.696952 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.697127 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.697250 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.697436 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.697558 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.697748 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.697879 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.698057 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.698191 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.698367 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.698496 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.698678 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.698810 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.698992 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.699128 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.699319 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.699457 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.699591 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.699748 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.699947 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.700072 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.700264 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.700387 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.700579 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.700695 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.700903 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.701033 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.701222 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.701353 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.701526 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.701651 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.701836 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.701961 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.702140 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.702274 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.702446 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.702572 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.702751 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.702876 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.703061 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.703192 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.703384 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.703640 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.703769 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.703891 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.704014 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.704212 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.704347 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.704521 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.704646 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.704828 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.704953 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.705151 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.705284 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.705463 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.705593 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.705770 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.705894 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.706080 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.706206 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.706387 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.706504 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.706691 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.706823 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.707001 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.707126 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.707308 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.707432 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.707676 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.707822 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.707990 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.708126 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.708321 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.708451 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.708635 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.708768 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.708952 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.709083 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.709262 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.709462 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.709586 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.709721 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.709876 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.710008 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.710188 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.710313 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.710504 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.710630 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.710813 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.710942 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.711127 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.711249 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.711436 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.711559 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.711778 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.711904 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.712088 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.712211 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.712403 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.712526 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.712708 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.712830 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.713026 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.713143 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.713353 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.713477 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.713664 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.713795 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.713984 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.714120 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.714307 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.714430 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.714619 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.714754 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.714936 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.715067 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.715247 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.715370 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.715559 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.715746 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.715893 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.716026 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.716203 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.716326 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.716519 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.716657 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.716828 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.716963 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.717140 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.717262 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.717448 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.717571 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.717759 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.717894 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.718069 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.718192 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.718376 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.718500 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.718681 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.718805 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.719020 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.719145 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.719342 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.719478 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.719769 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.719903 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.720033 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.720161 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.720290 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.720452 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.720618 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.720777 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.720932 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.721089 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.721247 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.721401 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.721569 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.721695 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.721882 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.722005 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.722194 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.722326 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.722506 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.722646 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.722814 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.722939 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.723122 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.723247 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.723438 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.723563 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.723780 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.723916 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.724092 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.724225 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.724404 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.724526 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.724709 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.724831 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.725013 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.725144 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.725325 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.725447 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.725635 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.725758 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.725944 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.726079 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.726257 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.726386 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.726579 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.726700 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.726886 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.727019 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.727192 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.727316 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.727516 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.727652 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.727849 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.727973 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.728154 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.728277 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.728457 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.728580 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.728762 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.728893 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.729068 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.729198 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.729378 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.729510 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.729731 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.729865 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.729982 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.730101 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.730301 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.730434 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.730610 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.730746 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.730923 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.731086 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.731232 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.731364 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.731541 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.731709 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.731883 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.732014 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.732194 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.732328 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.732503 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.732625 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.732814 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.732938 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.733126 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.733257 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.733434 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.733555 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.733743 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.733872 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.734055 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.734187 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.734363 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.734486 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.735193 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.735352 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.735485 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.735637 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.735815 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.735941 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.736134 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.736258 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.736453 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.736590 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.736812 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.737017 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.737141 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.737353 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.737479 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.737672 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.737983 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.738108 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.738303 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.738438 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.738625 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.738750 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.738947 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.739076 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.739271 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.739404 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.739613 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.739740 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.739950 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.740082 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.740205 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.740325 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.740515 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.740649 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.740821 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.740955 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.741133 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.741258 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.741438 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.741575 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.741746 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.741871 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.742051 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.742188 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.742360 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.742493 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.742667 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.742793 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.742972 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.743102 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.743276 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.743411 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.743580 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.743749 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.743910 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.744033 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.744214 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.744412 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.744536 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.744657 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.744820 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.744950 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.745124 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.745247 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.745439 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.745563 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.745741 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.745866 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.746085 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.746215 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.746357 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.746483 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.746662 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.746786 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.746970 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.747095 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.747278 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.747403 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.747646 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.747784 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.747959 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.748083 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.748285 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.748407 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.748592 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.748734 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.748917 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.749043 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.749223 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.749347 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.749529 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.749662 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.750091 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.750296 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.750942 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.751080 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.751253 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.751389 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.751563 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.751746 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.751903 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.752028 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.752216 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.752341 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.752524 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.752657 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.752835 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.752957 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.753140 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.753267 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.753451 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.753566 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.753756 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.753885 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.754061 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.754192 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.754370 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.754493 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.754675 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.754798 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.754978 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.755102 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.755290 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.755415 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.755614 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.755751 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.755920 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.756042 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.756237 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.756362 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.756540 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.756672 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.756855 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.756979 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.757161 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.757285 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.757465 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.757596 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.757767 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.757897 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.758076 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.758202 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.758383 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.758516 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.758685 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.758807 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.758995 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.759118 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.759306 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.759436 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.759622 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.759747 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.759921 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.760044 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.760233 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.760358 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.760539 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.760645 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.760842 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.760940 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.761149 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.761245 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.761455 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.761551 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.761760 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.761855 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.762063 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.762157 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.762373 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.762468 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.762680 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.762791 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.762986 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.763080 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.763289 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.763393 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.763671 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.763811 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.763920 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.764074 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.764207 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.764329 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.764513 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.764647 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.764815 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.764939 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.765118 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.765241 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.765421 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.765557 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.765727 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.765859 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.766062 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.766186 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.766368 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.766499 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.766672 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.766796 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.767017 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.767141 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.767324 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.767449 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.767673 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.767809 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.767999 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.768129 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.768313 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.768443 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.768630 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.768752 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.768944 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.769068 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.769256 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.769388 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.769569 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.769693 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.769875 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.770009 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.770185 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.770323 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.770506 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.770628 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.770791 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.770922 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.771098 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.771219 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.771408 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.771523 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.771747 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.771862 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.772057 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.772153 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.772364 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.772467 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.772685 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.772791 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.773001 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.773096 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.773314 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.773418 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.773618 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.773805 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.773929 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.774065 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.774239 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.774368 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.774549 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.774675 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.774858 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.774981 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.775164 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.775289 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.775471 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.775615 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.775808 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.775931 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.776118 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.776241 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.776429 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.776553 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.776740 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.776862 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.777046 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.777170 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.777357 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.777482 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.777664 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.777787 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.777969 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.778102 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.778278 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.778402 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.778588 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.778713 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.778892 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.779024 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.779201 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.779326 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.779506 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.779678 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.779836 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.779969 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.780142 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.780265 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.780447 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.780645 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.780778 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.780909 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.781053 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.781178 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.781484 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.781671 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.781809 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.781924 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.782104 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.782227 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.782412 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.782544 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.782725 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.782850 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.783044 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.783168 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.783361 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.783485 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.783702 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.783830 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.784010 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.784136 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.784396 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.784519 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.784705 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.784831 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.785013 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.785137 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.785325 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.785464 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.785638 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.785770 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.785947 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.786080 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.786253 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.786386 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.786562 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.786686 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.786871 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.787001 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.787179 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.787310 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.787486 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.787628 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.787839 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.787975 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.788149 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.788287 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.788473 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.788598 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.788896 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.789022 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.789211 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.789336 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.789519 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.789644 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.789839 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.789962 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.790161 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.790294 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.790484 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.790609 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.790807 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.790939 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.791094 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.791219 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.791403 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.791537 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.791750 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.791877 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.792076 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.792202 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.792386 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.792510 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.792698 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.792829 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.793007 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.793133 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.793330 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.793457 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.793644 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.793768 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.793952 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.794101 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.794299 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.794434 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.794590 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.794714 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.794905 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.795039 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.795232 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.795357 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.795591 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.795743 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.795941 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.796078 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.796249 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.796374 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.796555 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.796680 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.796869 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.797006 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.797745 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.797873 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.798077 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.798316 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.798451 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.798652 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.798784 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.798965 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.799091 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.799284 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.799419 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.799589 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.799745 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.799929 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.800054 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.800239 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.800375 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.800548 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.800673 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.800882 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.801013 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.801158 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.801293 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.801481 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.801605 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.801786 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.801909 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.802110 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.802235 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.802426 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.802550 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.802733 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.802868 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.803058 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.803184 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.803365 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.803489 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.803692 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.803817 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.804001 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.804128 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.804307 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.804438 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.804616 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.804749 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.804924 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.805050 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.805251 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.805374 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.805562 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.805695 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.805885 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.806085 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.806210 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.806329 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.806520 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.806659 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.806835 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.806967 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.807153 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.807276 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.807473 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.807628 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.807816 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.807948 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.808122 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.808245 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.808430 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.808564 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.808741 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.808865 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.809046 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.809173 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.809353 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.809478 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.809657 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.809787 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.809964 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.810087 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.810267 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.810399 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.810570 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.810693 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.810872 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.811070 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.811204 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.811327 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.811469 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.811660 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.811816 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.811953 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.812121 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.812255 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.812425 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.812547 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.812773 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.813405 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.813625 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.813750 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.813936 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.814062 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.814242 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.814434 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.814587 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.814712 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.814893 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.815017 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.815225 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.815359 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.815538 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.815682 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.815892 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.816018 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.816213 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.816339 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.816530 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.816653 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.816848 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.816973 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.817164 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.817289 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.817479 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.817602 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.817792 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.817917 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.818107 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.818232 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.818418 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.818543 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.818735 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.818858 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.819051 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.819257 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.819390 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.819588 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.819908 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.820044 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.820228 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.820353 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.820543 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.820668 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.820858 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.820990 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.821187 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.821311 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.821472 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.821596 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.821783 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.821919 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.822095 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.822220 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.822408 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.822534 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.822719 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.822851 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.823036 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.823162 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.823358 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.823482 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.823718 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.823847 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.824040 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.824166 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.824357 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.824481 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.824675 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.824808 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.824991 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.825117 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.825308 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.825439 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.825627 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.825752 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.825946 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.826077 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.826265 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.826399 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.826581 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.826706 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.826895 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.827017 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.827209 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.827334 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.827523 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.827694 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.827857 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.827982 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.828170 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.828296 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.828507 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.828630 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.828819 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.828944 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.829136 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.829262 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.829447 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.829579 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.829765 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.829900 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.830084 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.830209 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.830408 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.830534 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.830746 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.830880 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.831071 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.831209 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.831393 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.831518 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.831716 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.832031 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.832158 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.832349 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.832548 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.832676 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.832868 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.833072 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.833244 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.833477 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.833602 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.833802 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.833935 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.834123 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.834247 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.834450 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.834568 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.834759 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.834884 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.835629 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.835743 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.835818 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.835887 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.835955 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.836039 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.836109 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.836185 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.836340 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.836426 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.836662 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.836771 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.836974 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.837068 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.837336 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.837433 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.837601 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.837696 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.837939 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.838148 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.838449 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.838545 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.838800 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.838896 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.839119 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.839211 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.839443 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.839535 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.839791 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.839895 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.840104 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.840196 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.840411 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.840512 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.840730 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.840821 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.841037 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.841128 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.841347 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.841452 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.841659 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.841750 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.841969 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.842070 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.842345 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.842601 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.842816 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.843047 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.843262 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.843469 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.843739 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.843909 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.844060 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.844217 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.844217 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.844485 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.844485 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.844859 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.844859 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.845107 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.845328 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.845534 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.845748 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.845956 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.846162 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.846377 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.846586 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.846798 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.847013 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.847223 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.847431 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.847729 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.847924 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.848091 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.848301 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.848521 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.848743 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.848952 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.849149 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.849348 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.849572 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.849774 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.849970 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.850174 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.850377 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.850603 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.850805 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.851031 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.851259 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.851474 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.851705 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.851937 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.852145 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.852413 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.852413 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.852647 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.852647 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.852885 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.853007 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.853127 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.853250 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.853370 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.853498 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.853628 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.853756 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.853879 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.853879 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.854104 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.854104 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.854309 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.854309 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.854510 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.854510 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.854711 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.854711 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.854916 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.855020 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.855123 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.855225 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.855329 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.855442 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.855547 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.855676 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.855784 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.855888 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.856010 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.856125 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.856231 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.856342 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.856447 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.856550 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.856663 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.856768 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.856872 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.856975 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.857079 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.857189 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.857307 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.857413 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.857517 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.857620 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.857723 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.857826 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.857938 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.858043 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.858147 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.858250 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.858353 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.858464 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.858570 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.858770 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.858884 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.859528 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.860210 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.860321 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.860453 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.860577 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.860577 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.860891 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.861029 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.861216 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.861343 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.861537 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.861664 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.861856 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.861982 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.862177 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.862312 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.862524 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.862656 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.862788 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.862918 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.863101 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.863227 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.863415 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.863553 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.863756 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.863883 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.864079 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.864205 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.864397 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.864531 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.864706 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.864840 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.865012 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.865135 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.865435 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.865568 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.865747 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.865871 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.866067 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.866200 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.866377 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.866511 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.866692 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.866816 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.867015 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.867139 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.867328 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.867454 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.867665 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.867810 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.867982 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.868106 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.868292 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.868416 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.868623 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.868750 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.868962 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.869078 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.869290 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.869415 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.869598 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.869723 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.869906 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.870041 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.870210 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.870334 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.870517 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.870643 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.870827 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.870962 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.871138 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.871262 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.871444 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.871570 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.871773 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.871915 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.872080 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.872205 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.872385 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.872509 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.872705 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.872840 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.872964 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.873086 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.873271 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.873397 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.873600 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.873740 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.873988 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.874127 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.874259 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.874403 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.874654 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.875037 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.875167 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.875871 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.875871 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.876145 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.876286 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.876465 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.876591 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.876777 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.876903 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.877092 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.877226 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.877401 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.877525 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.877711 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.877834 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.878017 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.878144 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.878322 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.878445 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.878628 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.878761 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.878962 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.879132 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.879285 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.879418 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.879649 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.879778 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.879946 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.880070 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.880258 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.880391 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.880581 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.880704 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.880892 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.881018 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.881208 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.881332 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.881521 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.881656 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.881836 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.881959 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.882149 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.882275 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.882461 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.882592 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.882775 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.882908 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.883083 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.883209 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.883393 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.883527 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.883729 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.883864 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.884039 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.884173 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.884351 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.884484 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.884688 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.884828 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.884990 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.885123 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.885296 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.885422 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.885620 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.885744 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.885938 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.886074 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.886249 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.886376 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.886566 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.886690 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.886878 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.887011 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.887190 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.887315 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.887502 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.887690 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.887842 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.887976 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.888152 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.888275 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.888465 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.888592 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.888776 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.888908 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.889091 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.889215 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.889400 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.889524 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.889716 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.889853 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.890047 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.890172 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.890377 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.890501 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.890689 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.890834 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.891059 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.891183 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.891391 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.891516 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.891767 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.891895 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.892085 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.892218 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.892433 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.892558 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.892748 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.892872 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.893068 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.893192 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.893384 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.893518 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.893692 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.893818 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.893939 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103148) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 06:54:23.894069 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.894313 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 06:54:23.894572 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103147) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 06:54:24.050101 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: INFO dbcounter [None req-7a1be332-e48a-4e5a-bed1-20b4a687c5cc None None] Registered counter for database nova_api Aug 09 06:54:24.051196 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: INFO dbcounter [None req-2be9f77c-3221-4449-928f-7e6515559d91 None None] Registered counter for database nova_api Aug 09 06:54:24.071528 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG oslo_db.sqlalchemy.engines [None req-7a1be332-e48a-4e5a-bed1-20b4a687c5cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 06:54:24.073308 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG oslo_db.sqlalchemy.engines [None req-2be9f77c-3221-4449-928f-7e6515559d91 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103147) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 06:54:24.078162 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG dbcounter [-] [103148] Writer thread running {{(pid=103148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 06:54:24.080025 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG dbcounter [-] [103147] Writer thread running {{(pid=103147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 06:54:24.134999 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.context [None req-7a1be332-e48a-4e5a-bed1-20b4a687c5cc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),82160e21-03c7-4992-b3b2-4a6a6de7b596(cell1) {{(pid=103148) load_cells /opt/stack/nova/nova/context.py:464}} Aug 09 06:54:24.136671 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.context [None req-2be9f77c-3221-4449-928f-7e6515559d91 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),82160e21-03c7-4992-b3b2-4a6a6de7b596(cell1) {{(pid=103147) load_cells /opt/stack/nova/nova/context.py:464}} Aug 09 06:54:24.138823 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG oslo_concurrency.lockutils [None req-7a1be332-e48a-4e5a-bed1-20b4a687c5cc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 06:54:24.139303 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG oslo_concurrency.lockutils [None req-7a1be332-e48a-4e5a-bed1-20b4a687c5cc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 06:54:24.140600 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-2be9f77c-3221-4449-928f-7e6515559d91 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 06:54:24.140954 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG oslo_concurrency.lockutils [None req-7a1be332-e48a-4e5a-bed1-20b4a687c5cc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 06:54:24.141233 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-2be9f77c-3221-4449-928f-7e6515559d91 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 06:54:24.141695 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG oslo_concurrency.lockutils [None req-7a1be332-e48a-4e5a-bed1-20b4a687c5cc None None] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 06:54:24.142145 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG oslo_concurrency.lockutils [None req-7a1be332-e48a-4e5a-bed1-20b4a687c5cc None None] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 06:54:24.142817 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-2be9f77c-3221-4449-928f-7e6515559d91 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 06:54:24.143565 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-2be9f77c-3221-4449-928f-7e6515559d91 None None] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 06:54:24.144039 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-2be9f77c-3221-4449-928f-7e6515559d91 None None] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 06:54:24.144156 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG oslo_concurrency.lockutils [None req-7a1be332-e48a-4e5a-bed1-20b4a687c5cc None None] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103148) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 06:54:24.146013 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-2be9f77c-3221-4449-928f-7e6515559d91 None None] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 06:54:24.146151 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: INFO dbcounter [None req-7a1be332-e48a-4e5a-bed1-20b4a687c5cc None None] Registered counter for database nova_cell0 Aug 09 06:54:24.148005 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: INFO dbcounter [None req-2be9f77c-3221-4449-928f-7e6515559d91 None None] Registered counter for database nova_cell0 Aug 09 06:54:24.151626 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: INFO dbcounter [None req-7a1be332-e48a-4e5a-bed1-20b4a687c5cc None None] Registered counter for database nova_cell1 Aug 09 06:54:24.153501 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: INFO dbcounter [None req-2be9f77c-3221-4449-928f-7e6515559d91 None None] Registered counter for database nova_cell1 Aug 09 06:54:24.160065 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG oslo_db.sqlalchemy.engines [None req-7a1be332-e48a-4e5a-bed1-20b4a687c5cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 06:54:24.161511 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG oslo_db.sqlalchemy.engines [None req-2be9f77c-3221-4449-928f-7e6515559d91 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103147) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 06:54:24.162971 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG oslo_db.sqlalchemy.engines [None req-7a1be332-e48a-4e5a-bed1-20b4a687c5cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 06:54:24.166171 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG dbcounter [-] [103147] Writer thread running {{(pid=103147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 06:54:24.166805 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG oslo_db.sqlalchemy.engines [None req-2be9f77c-3221-4449-928f-7e6515559d91 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103147) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 06:54:24.169991 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG dbcounter [-] [103148] Writer thread running {{(pid=103148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 06:54:24.173048 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG dbcounter [-] [103148] Writer thread running {{(pid=103148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 06:54:24.308422 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG dbcounter [-] [103147] Writer thread running {{(pid=103147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 06:54:24.317196 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: INFO dbcounter [None req-2be9f77c-3221-4449-928f-7e6515559d91 None None] Registered counter for database nova_cell0 Aug 09 06:54:24.317834 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: INFO dbcounter [None req-7a1be332-e48a-4e5a-bed1-20b4a687c5cc None None] Registered counter for database nova_cell0 Aug 09 06:54:24.326546 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG oslo_db.sqlalchemy.engines [None req-7a1be332-e48a-4e5a-bed1-20b4a687c5cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103148) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 06:54:24.330895 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG oslo_db.sqlalchemy.engines [None req-2be9f77c-3221-4449-928f-7e6515559d91 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103147) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 06:54:24.331623 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG dbcounter [-] [103148] Writer thread running {{(pid=103148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 06:54:24.335207 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG dbcounter [-] [103147] Writer thread running {{(pid=103147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 06:54:24.668592 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: WARNING keystonemiddleware.auth_token [None req-2be9f77c-3221-4449-928f-7e6515559d91 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 06:54:24.673598 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: WARNING keystonemiddleware.auth_token [None req-7a1be332-e48a-4e5a-bed1-20b4a687c5cc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 06:54:24.675845 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: WARNING keystonemiddleware.auth_token [None req-2be9f77c-3221-4449-928f-7e6515559d91 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 06:54:24.680825 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: WARNING keystonemiddleware.auth_token [None req-7a1be332-e48a-4e5a-bed1-20b4a687c5cc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 06:54:25.014355 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: WARNING keystonemiddleware.auth_token [None req-2be9f77c-3221-4449-928f-7e6515559d91 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 06:54:25.020917 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: WARNING keystonemiddleware.auth_token [None req-2be9f77c-3221-4449-928f-7e6515559d91 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 06:54:25.023064 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: WARNING keystonemiddleware.auth_token [None req-7a1be332-e48a-4e5a-bed1-20b4a687c5cc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 06:54:25.026155 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5587d76349c0 pid: 103147 (default app) Aug 09 06:54:25.028218 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-2be9f77c-3221-4449-928f-7e6515559d91 None None] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 06:54:25.029026 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: WARNING keystonemiddleware.auth_token [None req-7a1be332-e48a-4e5a-bed1-20b4a687c5cc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 06:54:25.029391 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-2be9f77c-3221-4449-928f-7e6515559d91 None None] 10.222.0.30 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001729 Aug 09 06:54:25.029795 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 1/1] 10.222.0.30 () {50 vars in 788 bytes} [Tue Aug 9 06:54:25 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 06:54:25.034485 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5587d76349c0 pid: 103148 (default app) Aug 09 06:55:40.539381 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-2be9f77c-3221-4449-928f-7e6515559d91 None None] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 06:55:40.540963 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-2be9f77c-3221-4449-928f-7e6515559d91 None None] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002009 Aug 09 06:55:40.541343 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 2/2] 10.222.0.30 () {54 vars in 931 bytes} [Tue Aug 9 06:55:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 06:55:40.554221 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG dbcounter [-] [103148] Writing DB stats nova_api:SELECT=3 {{(pid=103148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:40.555153 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG dbcounter [-] [103148] Writing DB stats nova_cell0:SELECT=3 {{(pid=103148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:40.556063 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG dbcounter [-] [103148] Writing DB stats nova_cell1:SELECT=3 {{(pid=103148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:40.556778 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG dbcounter [-] [103148] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:41.384979 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-7bf3fc1e-f933-498d-8d6a-23a129199b20 admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 06:55:41.417619 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-7bf3fc1e-f933-498d-8d6a-23a129199b20 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.868527 Aug 09 06:55:41.419293 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 1/3] 10.222.0.30 () {60 vars in 1292 bytes} [Tue Aug 9 06:55:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 06:55:43.656040 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-2be9f77c-3221-4449-928f-7e6515559d91 None None] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 06:55:43.657033 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-2be9f77c-3221-4449-928f-7e6515559d91 None None] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Aug 09 06:55:43.657721 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 3/4] 10.222.0.30 () {54 vars in 931 bytes} [Tue Aug 9 06:55:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 06:55:44.112651 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-a2c3447b-5837-43e1-bb59-e8980f31367c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "cirros256", "disk": 1, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "swap": 0, "id": "c1", "rxtx_factor": 1.0}} {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 06:55:44.132826 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 06:55:44.132826 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: warnings.warn(msg) Aug 09 06:55:44.159875 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-a2c3447b-5837-43e1-bb59-e8980f31367c admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.495780 Aug 09 06:55:44.167471 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 2/5] 10.222.0.30 () {64 vars in 1283 bytes} [Tue Aug 9 06:55:43 2022] POST /compute/v2.1/flavors => generated 407 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 06:55:44.174754 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG dbcounter [-] [103147] Writing DB stats nova_api:SELECT=3 {{(pid=103147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:44.175861 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG dbcounter [-] [103147] Writing DB stats nova_cell0:SELECT=3 {{(pid=103147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:44.176574 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG dbcounter [-] [103147] Writing DB stats nova_cell1:SELECT=3 {{(pid=103147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:44.177549 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG dbcounter [-] [103147] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:55:44.381380 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-056dde21-1f6b-4d87-9954-2707b9a4ebde admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 06:55:44.385705 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 06:55:44.385705 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: warnings.warn(msg) Aug 09 06:55:44.448186 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-056dde21-1f6b-4d87-9954-2707b9a4ebde admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.278560 Aug 09 06:55:44.448974 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 4/6] 10.222.0.30 () {64 vars in 1336 bytes} [Tue Aug 9 06:55:44 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 06:55:46.692765 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-a2c3447b-5837-43e1-bb59-e8980f31367c admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 06:55:46.693936 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-a2c3447b-5837-43e1-bb59-e8980f31367c admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001622 Aug 09 06:55:46.694484 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 3/7] 10.222.0.30 () {54 vars in 931 bytes} [Tue Aug 9 06:55:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 06:55:47.360007 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-4a9ac79d-ad19-4781-8419-0ab6f3f653bc admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 512, "id": "d1", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "name": "ds512M", "disk": 5}} {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 06:55:47.380566 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 06:55:47.380566 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: warnings.warn(msg) Aug 09 06:55:47.403526 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-4a9ac79d-ad19-4781-8419-0ab6f3f653bc admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.700631 Aug 09 06:55:47.411164 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 5/8] 10.222.0.30 () {64 vars in 1283 bytes} [Tue Aug 9 06:55:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 06:55:47.416545 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-a636dcb7-8972-4403-8a4d-efa22a610dcc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 06:55:47.420365 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 06:55:47.420365 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: warnings.warn(msg) Aug 09 06:55:47.456701 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-a636dcb7-8972-4403-8a4d-efa22a610dcc admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043727 Aug 09 06:55:47.458055 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 4/9] 10.222.0.30 () {64 vars in 1336 bytes} [Tue Aug 9 06:55:47 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 06:55:49.711061 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-4a9ac79d-ad19-4781-8419-0ab6f3f653bc admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 06:55:49.712098 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-4a9ac79d-ad19-4781-8419-0ab6f3f653bc admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Aug 09 06:55:49.712506 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 6/10] 10.222.0.30 () {54 vars in 931 bytes} [Tue Aug 9 06:55:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 06:55:50.110513 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-ba2f3904-60dd-4021-9a99-db5d2e750eae admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "disk": 10, "vcpus": 1, "id": "d2", "rxtx_factor": 1.0, "name": "ds1G", "ram": 1024}} {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 06:55:50.129909 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-ba2f3904-60dd-4021-9a99-db5d2e750eae admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.409644 Aug 09 06:55:50.130547 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 5/11] 10.222.0.30 () {64 vars in 1283 bytes} [Tue Aug 9 06:55:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 06:55:50.143469 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-2c7e8198-f1fd-4931-b06c-62adb7d3dab7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 06:55:50.168660 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-2c7e8198-f1fd-4931-b06c-62adb7d3dab7 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028893 Aug 09 06:55:50.169237 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 7/12] 10.222.0.30 () {64 vars in 1336 bytes} [Tue Aug 9 06:55:50 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 06:55:52.388375 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-ba2f3904-60dd-4021-9a99-db5d2e750eae admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 06:55:52.389398 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-ba2f3904-60dd-4021-9a99-db5d2e750eae admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Aug 09 06:55:52.389816 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 6/13] 10.222.0.30 () {54 vars in 931 bytes} [Tue Aug 9 06:55:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 06:55:52.825881 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-59e05e67-f2f3-41ca-9aeb-eaae91fdcf77 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "id": "d3", "os-flavor-access:is_public": true, "disk": 10, "rxtx_factor": 1.0, "name": "ds2G", "swap": 0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 06:55:52.858783 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-59e05e67-f2f3-41ca-9aeb-eaae91fdcf77 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.462800 Aug 09 06:55:52.860931 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 8/14] 10.222.0.30 () {64 vars in 1283 bytes} [Tue Aug 9 06:55:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 06:55:52.871980 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-119e86d7-934e-49b9-bde1-ff572e121d44 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 06:55:52.895992 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-119e86d7-934e-49b9-bde1-ff572e121d44 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028255 Aug 09 06:55:52.900746 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 7/15] 10.222.0.30 () {64 vars in 1336 bytes} [Tue Aug 9 06:55:52 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 06:55:55.134776 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-59e05e67-f2f3-41ca-9aeb-eaae91fdcf77 admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 06:55:55.135897 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-59e05e67-f2f3-41ca-9aeb-eaae91fdcf77 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Aug 09 06:55:55.136288 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 9/16] 10.222.0.30 () {54 vars in 931 bytes} [Tue Aug 9 06:55:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 06:55:55.556922 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-e04dc299-405b-48bc-9d84-1ca2693deaf8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "ram": 4096, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "vcpus": 4, "os-flavor-access:is_public": true, "id": "d4"}} {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 06:55:55.580052 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-e04dc299-405b-48bc-9d84-1ca2693deaf8 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.437622 Aug 09 06:55:55.580938 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 8/17] 10.222.0.30 () {64 vars in 1283 bytes} [Tue Aug 9 06:55:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 06:55:55.592930 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-54d6399b-d6b7-4901-8d59-049f37ea6922 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 06:55:55.617092 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-54d6399b-d6b7-4901-8d59-049f37ea6922 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028012 Aug 09 06:55:55.617825 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 10/18] 10.222.0.30 () {64 vars in 1336 bytes} [Tue Aug 9 06:55:55 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 06:55:58.132474 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-e04dc299-405b-48bc-9d84-1ca2693deaf8 admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 06:55:58.133735 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-e04dc299-405b-48bc-9d84-1ca2693deaf8 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001973 Aug 09 06:55:58.134267 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 9/19] 10.222.0.30 () {54 vars in 931 bytes} [Tue Aug 9 06:55:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 06:55:58.567252 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-433e9b7d-ff74-42bf-93ba-e3a7876d8fe0 admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 06:55:58.599398 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-433e9b7d-ff74-42bf-93ba-e3a7876d8fe0 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.456471 Aug 09 06:55:58.600208 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 11/20] 10.222.0.30 () {60 vars in 1292 bytes} [Tue Aug 9 06:55:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 06:56:00.865393 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-e04dc299-405b-48bc-9d84-1ca2693deaf8 admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 06:56:00.866568 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-e04dc299-405b-48bc-9d84-1ca2693deaf8 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001586 Aug 09 06:56:00.867044 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 10/21] 10.222.0.30 () {54 vars in 931 bytes} [Tue Aug 9 06:56:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 06:56:01.273222 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-b222dd67-fa63-46ab-81eb-7152bdcde845 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "name": "m1.tiny", "swap": 0, "disk": 1, "ram": 512, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 06:56:01.292800 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-b222dd67-fa63-46ab-81eb-7152bdcde845 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.419361 Aug 09 06:56:01.293583 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 12/22] 10.222.0.30 () {64 vars in 1283 bytes} [Tue Aug 9 06:56:00 2022] POST /compute/v2.1/flavors => generated 402 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 06:56:01.305481 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-49888959-691b-4da7-83df-2f5aedb76da0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 06:56:01.330187 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-49888959-691b-4da7-83df-2f5aedb76da0 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028274 Aug 09 06:56:01.330763 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 11/23] 10.222.0.30 () {64 vars in 1333 bytes} [Tue Aug 9 06:56:01 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 06:56:03.524143 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-b222dd67-fa63-46ab-81eb-7152bdcde845 admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 06:56:03.525163 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-b222dd67-fa63-46ab-81eb-7152bdcde845 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Aug 09 06:56:03.525589 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 13/24] 10.222.0.30 () {54 vars in 931 bytes} [Tue Aug 9 06:56:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 06:56:03.926423 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-803231dd-b272-44ae-8273-b64d17184728 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "os-flavor-access:is_public": true, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "name": "m1.small", "vcpus": 1, "ram": 2048}} {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 06:56:03.945173 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-803231dd-b272-44ae-8273-b64d17184728 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.413198 Aug 09 06:56:03.945755 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 12/25] 10.222.0.30 () {64 vars in 1283 bytes} [Tue Aug 9 06:56:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 06:56:03.957765 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-d8f8563c-cd9e-4da8-ba98-ce4621cab97c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 06:56:03.982359 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-d8f8563c-cd9e-4da8-ba98-ce4621cab97c admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028330 Aug 09 06:56:03.982938 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 14/26] 10.222.0.30 () {64 vars in 1333 bytes} [Tue Aug 9 06:56:03 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 06:56:06.178516 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-803231dd-b272-44ae-8273-b64d17184728 admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 06:56:06.179534 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-803231dd-b272-44ae-8273-b64d17184728 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Aug 09 06:56:06.179976 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 13/27] 10.222.0.30 () {54 vars in 931 bytes} [Tue Aug 9 06:56:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 06:56:06.552535 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-6e5b5ca3-436c-4ff1-97c2-0f013e930355 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "3", "name": "m1.medium", "ram": 4096, "vcpus": 2, "disk": 40, "rxtx_factor": 1.0, "swap": 0}} {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 06:56:06.571074 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-6e5b5ca3-436c-4ff1-97c2-0f013e930355 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.384844 Aug 09 06:56:06.571749 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 15/28] 10.222.0.30 () {64 vars in 1283 bytes} [Tue Aug 9 06:56:06 2022] POST /compute/v2.1/flavors => generated 406 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 06:56:06.584907 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-79e3c847-8b32-4701-bbb4-8540a7384f5f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 06:56:06.613405 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-79e3c847-8b32-4701-bbb4-8540a7384f5f admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032097 Aug 09 06:56:06.613964 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 14/29] 10.222.0.30 () {64 vars in 1333 bytes} [Tue Aug 9 06:56:06 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 06:56:08.956831 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-6e5b5ca3-436c-4ff1-97c2-0f013e930355 admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 06:56:08.957839 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-6e5b5ca3-436c-4ff1-97c2-0f013e930355 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Aug 09 06:56:08.958527 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 16/30] 10.222.0.30 () {54 vars in 931 bytes} [Tue Aug 9 06:56:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 06:56:09.496068 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-02b7c686-af49-4653-a797-b10ab036fc4b admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "rxtx_factor": 1.0, "swap": 0, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "os-flavor-access:is_public": true, "vcpus": 4, "ram": 8192}} {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 06:56:09.522647 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-02b7c686-af49-4653-a797-b10ab036fc4b admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.557781 Aug 09 06:56:09.523924 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 15/31] 10.222.0.30 () {64 vars in 1283 bytes} [Tue Aug 9 06:56:08 2022] POST /compute/v2.1/flavors => generated 405 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 06:56:09.537466 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-2a68c9c2-f6e4-4890-badf-b01e11887248 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 06:56:09.578347 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-2a68c9c2-f6e4-4890-badf-b01e11887248 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045593 Aug 09 06:56:09.579279 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 17/32] 10.222.0.30 () {64 vars in 1333 bytes} [Tue Aug 9 06:56:09 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 06:56:11.864791 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-02b7c686-af49-4653-a797-b10ab036fc4b admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 06:56:11.865898 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-02b7c686-af49-4653-a797-b10ab036fc4b admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Aug 09 06:56:11.866319 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 16/33] 10.222.0.30 () {54 vars in 931 bytes} [Tue Aug 9 06:56:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 06:56:12.311660 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-06d46538-0b9c-496f-a863-996f85caa6b0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 16384, "vcpus": 8, "disk": 160}} {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 06:56:12.331908 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-06d46538-0b9c-496f-a863-996f85caa6b0 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.458773 Aug 09 06:56:12.343778 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 18/34] 10.222.0.30 () {64 vars in 1283 bytes} [Tue Aug 9 06:56:11 2022] POST /compute/v2.1/flavors => generated 408 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 06:56:12.345142 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-17a39713-e862-42c8-9e33-f0b8c69ce30a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 06:56:12.350105 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG dbcounter [-] [103148] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:12.382383 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-17a39713-e862-42c8-9e33-f0b8c69ce30a admin admin] 10.222.0.30 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041031 Aug 09 06:56:12.383186 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 17/35] 10.222.0.30 () {64 vars in 1333 bytes} [Tue Aug 9 06:56:12 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 06:56:31.816902 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-06d46538-0b9c-496f-a863-996f85caa6b0 admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 06:56:31.817915 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-06d46538-0b9c-496f-a863-996f85caa6b0 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Aug 09 06:56:31.818304 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 19/36] 10.222.0.30 () {54 vars in 931 bytes} [Tue Aug 9 06:56:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 06:56:31.829407 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG dbcounter [-] [103148] Writing DB stats nova_api:SELECT=5,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:32.218003 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-062665a9-67a8-4a2e-a234-29864818e064 admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 06:56:32.236521 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-062665a9-67a8-4a2e-a234-29864818e064 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.411516 Aug 09 06:56:32.236983 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 18/37] 10.222.0.30 () {60 vars in 1292 bytes} [Tue Aug 9 06:56:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 06:56:33.299178 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-06d46538-0b9c-496f-a863-996f85caa6b0 admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 06:56:33.300221 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-06d46538-0b9c-496f-a863-996f85caa6b0 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Aug 09 06:56:33.300612 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 20/38] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Aug 9 06:56:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 06:56:33.819704 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-b4868833-ba78-436a-83a4-e5c049d68561 admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 06:56:33.825436 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.wsgi [None req-b4868833-ba78-436a-83a4-e5c049d68561 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 09 06:56:33.828776 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-b4868833-ba78-436a-83a4-e5c049d68561 admin admin] Request method failure captured: Aug 09 06:56:33.828776 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 09 06:56:33.828776 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: Accept: application/json Aug 09 06:56:33.828776 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: Accept-Encoding: gzip, deflate Aug 09 06:56:33.828776 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: Connection: keep-alive Aug 09 06:56:33.828776 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: Content-Length: 0 Aug 09 06:56:33.828776 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: Host: 10.222.0.30 Aug 09 06:56:33.828776 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: Openstack-Api-Version: compute 2.90 Aug 09 06:56:33.828776 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: Openstack-System-Scope: None Aug 09 06:56:33.828776 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: User-Agent: python-novaclient Aug 09 06:56:33.828776 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-Auth-Token: gAAAAABi8gUhmMMO6jmjkuovcA5QTQecTXmpqKkBhtt-OKwaGo43TAw7xoxJVXk0abZwMfa-hZGEY66o00h7NuGXhp1re2cXO3HOH56yfbqXFHrOmF2A5wv3RWTyYzGFuTxjHMYrzPOkHF3YnWHth7lmVYNqwJ_SuC7jZBocfqDwYVyku7XTgIA Aug 09 06:56:33.828776 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-Domain-Id: None Aug 09 06:56:33.828776 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-Domain-Name: None Aug 09 06:56:33.828776 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-Identity-Status: Confirmed Aug 09 06:56:33.828776 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-Is-Admin-Project: True Aug 09 06:56:33.828776 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 06:56:33.828776 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-Project-Domain-Id: default Aug 09 06:56:33.828776 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-Project-Domain-Name: Default Aug 09 06:56:33.828776 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-Project-Id: 489e2c3ffdae42c6a83d2b2655912ea9 Aug 09 06:56:33.828776 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-Project-Name: admin Aug 09 06:56:33.828776 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-Role: reader,admin,member Aug 09 06:56:33.828776 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-Roles: reader,admin,member Aug 09 06:56:33.830449 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/489e2c3ffdae42c6a83d2b2655912ea9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_489e2c3ffdae42c6a83d2b2655912ea9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/489e2c3ffdae42c6a83d2b2655912ea9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/489e2c3ffdae42c6a83d2b2655912ea9"}]}] Aug 09 06:56:33.830449 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-Tenant: admin Aug 09 06:56:33.830449 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-Tenant-Id: 489e2c3ffdae42c6a83d2b2655912ea9 Aug 09 06:56:33.830449 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-Tenant-Name: admin Aug 09 06:56:33.830449 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-User: admin Aug 09 06:56:33.830449 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-User-Domain-Id: default Aug 09 06:56:33.830449 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-User-Domain-Name: Default Aug 09 06:56:33.830449 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-User-Id: b26927358e664fe3981d02119bbe804c Aug 09 06:56:33.830449 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-User-Name: admin Aug 09 06:56:33.830449 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: method: > Aug 09 06:56:33.830449 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: exception: Flavor 42 could not be found. Aug 09 06:56:33.830449 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: action_args: {'id': '42'} Aug 09 06:56:33.830449 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 06:56:33.830449 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 06:56:33.831619 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 06:56:33.831619 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 06:56:33.831619 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 06:56:33.831619 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 06:56:33.831619 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 06:56:33.831619 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 06:56:33.831619 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 06:56:33.831619 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 06:56:33.831619 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 06:56:33.831619 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 06:56:33.831619 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 06:56:33.831619 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 06:56:33.831619 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 09 06:56:33.831619 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Aug 09 06:56:33.831619 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 06:56:33.831619 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Aug 09 06:56:33.831619 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 06:56:33.831619 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 06:56:33.831619 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 06:56:33.833152 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 06:56:33.833152 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 06:56:33.833152 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 06:56:33.833152 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 06:56:33.833152 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 06:56:33.833152 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 06:56:33.833152 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 09 06:56:33.833152 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Aug 09 06:56:33.833152 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 06:56:33.833152 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Aug 09 06:56:33.833152 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 06:56:33.833152 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 06:56:33.833152 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 06:56:33.833152 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 06:56:33.833152 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 06:56:33.833152 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 09 06:56:33.833152 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Aug 09 06:56:33.833152 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-b4868833-ba78-436a-83a4-e5c049d68561 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103148) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 06:56:33.834438 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-b4868833-ba78-436a-83a4-e5c049d68561 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.390019 Aug 09 06:56:33.834438 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 19/39] 10.222.0.30 () {60 vars in 1190 bytes} [Tue Aug 9 06:56:33 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 06:56:33.840496 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-11bdcfe2-92ae-402d-8af7-297717cadba1 admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 06:56:33.844837 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG dbcounter [-] [103147] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:56:33.864764 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-11bdcfe2-92ae-402d-8af7-297717cadba1 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028292 Aug 09 06:56:33.865325 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 21/40] 10.222.0.30 () {60 vars in 1210 bytes} [Tue Aug 9 06:56:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 06:56:33.875490 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-c5132caa-298a-4b1c-8377-7d270e480e50 admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 06:56:33.904588 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-c5132caa-298a-4b1c-8377-7d270e480e50 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.032974 Aug 09 06:56:33.905138 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 20/41] 10.222.0.30 () {60 vars in 1210 bytes} [Tue Aug 9 06:56:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 06:56:33.914545 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-1bb1f658-c9d0-4228-a477-6e0cbe456f7a admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 06:56:33.921397 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.wsgi [None req-1bb1f658-c9d0-4228-a477-6e0cbe456f7a admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 09 06:56:33.924644 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-1bb1f658-c9d0-4228-a477-6e0cbe456f7a admin admin] Request method failure captured: Aug 09 06:56:33.924644 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 09 06:56:33.924644 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: Accept: application/json Aug 09 06:56:33.924644 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: Accept-Encoding: gzip, deflate Aug 09 06:56:33.924644 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: Connection: keep-alive Aug 09 06:56:33.924644 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: Content-Length: 0 Aug 09 06:56:33.924644 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: Host: 10.222.0.30 Aug 09 06:56:33.924644 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: Openstack-Api-Version: compute 2.90 Aug 09 06:56:33.924644 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: Openstack-System-Scope: None Aug 09 06:56:33.924644 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: User-Agent: python-novaclient Aug 09 06:56:33.924644 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-Auth-Token: gAAAAABi8gUhmMMO6jmjkuovcA5QTQecTXmpqKkBhtt-OKwaGo43TAw7xoxJVXk0abZwMfa-hZGEY66o00h7NuGXhp1re2cXO3HOH56yfbqXFHrOmF2A5wv3RWTyYzGFuTxjHMYrzPOkHF3YnWHth7lmVYNqwJ_SuC7jZBocfqDwYVyku7XTgIA Aug 09 06:56:33.924644 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-Domain-Id: None Aug 09 06:56:33.924644 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-Domain-Name: None Aug 09 06:56:33.924644 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-Identity-Status: Confirmed Aug 09 06:56:33.924644 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-Is-Admin-Project: True Aug 09 06:56:33.924644 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 06:56:33.924644 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-Project-Domain-Id: default Aug 09 06:56:33.924644 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-Project-Domain-Name: Default Aug 09 06:56:33.924644 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-Project-Id: 489e2c3ffdae42c6a83d2b2655912ea9 Aug 09 06:56:33.924644 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-Project-Name: admin Aug 09 06:56:33.924644 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-Role: reader,admin,member Aug 09 06:56:33.924644 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-Roles: reader,admin,member Aug 09 06:56:33.926028 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/489e2c3ffdae42c6a83d2b2655912ea9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_489e2c3ffdae42c6a83d2b2655912ea9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/489e2c3ffdae42c6a83d2b2655912ea9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/489e2c3ffdae42c6a83d2b2655912ea9"}]}] Aug 09 06:56:33.926028 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-Tenant: admin Aug 09 06:56:33.926028 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-Tenant-Id: 489e2c3ffdae42c6a83d2b2655912ea9 Aug 09 06:56:33.926028 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-Tenant-Name: admin Aug 09 06:56:33.926028 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-User: admin Aug 09 06:56:33.926028 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-User-Domain-Id: default Aug 09 06:56:33.926028 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-User-Domain-Name: Default Aug 09 06:56:33.926028 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-User-Id: b26927358e664fe3981d02119bbe804c Aug 09 06:56:33.926028 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-User-Name: admin Aug 09 06:56:33.926028 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: method: > Aug 09 06:56:33.926028 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: exception: Flavor 42 could not be found. Aug 09 06:56:33.926028 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: action_args: {'id': '42'} Aug 09 06:56:33.926028 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 06:56:33.926028 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 06:56:33.926809 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 06:56:33.926809 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 06:56:33.926809 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 06:56:33.926809 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 06:56:33.926809 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 06:56:33.926809 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 06:56:33.926809 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 06:56:33.926809 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 06:56:33.926809 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 06:56:33.926809 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 06:56:33.926809 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 06:56:33.926809 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 06:56:33.926809 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 09 06:56:33.926809 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Aug 09 06:56:33.926809 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 06:56:33.926809 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Aug 09 06:56:33.926809 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 06:56:33.926809 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 06:56:33.926809 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 06:56:33.927887 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 06:56:33.927887 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 06:56:33.927887 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 06:56:33.927887 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 06:56:33.927887 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 06:56:33.927887 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 06:56:33.927887 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 09 06:56:33.927887 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Aug 09 06:56:33.927887 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 06:56:33.927887 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Aug 09 06:56:33.927887 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 06:56:33.927887 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 06:56:33.927887 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 06:56:33.927887 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 06:56:33.927887 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 06:56:33.927887 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 09 06:56:33.927887 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Aug 09 06:56:33.927887 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-1bb1f658-c9d0-4228-a477-6e0cbe456f7a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103147) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 06:56:33.928871 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-1bb1f658-c9d0-4228-a477-6e0cbe456f7a admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015084 Aug 09 06:56:33.928871 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 22/42] 10.222.0.30 () {60 vars in 1190 bytes} [Tue Aug 9 06:56:33 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 06:56:35.002420 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-c5132caa-298a-4b1c-8377-7d270e480e50 admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 06:56:35.003454 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-c5132caa-298a-4b1c-8377-7d270e480e50 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 09 06:56:35.003898 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 21/43] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Aug 9 06:56:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 06:56:35.530303 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-a0793f06-c11d-4a21-9f0c-58ace982ce38 admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 06:56:35.535538 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.wsgi [None req-a0793f06-c11d-4a21-9f0c-58ace982ce38 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 09 06:56:35.537064 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-a0793f06-c11d-4a21-9f0c-58ace982ce38 admin admin] Request method failure captured: Aug 09 06:56:35.537064 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 09 06:56:35.537064 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: Accept: application/json Aug 09 06:56:35.537064 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: Accept-Encoding: gzip, deflate Aug 09 06:56:35.537064 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: Connection: keep-alive Aug 09 06:56:35.537064 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: Content-Length: 0 Aug 09 06:56:35.537064 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: Host: 10.222.0.30 Aug 09 06:56:35.537064 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: Openstack-Api-Version: compute 2.90 Aug 09 06:56:35.537064 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: Openstack-System-Scope: None Aug 09 06:56:35.537064 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: User-Agent: python-novaclient Aug 09 06:56:35.537064 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-Auth-Token: gAAAAABi8gUijIFQV-HwMdJLGcwWA6-169hia5OJHwmEyjMUxXmxiPsxRHJJnGk9wSI4uWrUdVE9Hnw3DBoNcTYifWRAqkjjp9Z-edqdZKjbFtuSkfvMi9GJ5Ay5DO5OL2wbBu9J6OEzBdLrwfc1Uzk-uNTeRfPcj5nDo3rZ7tctFpXauA4bsmM Aug 09 06:56:35.537064 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-Domain-Id: None Aug 09 06:56:35.537064 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-Domain-Name: None Aug 09 06:56:35.537064 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-Identity-Status: Confirmed Aug 09 06:56:35.537064 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-Is-Admin-Project: True Aug 09 06:56:35.537064 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 06:56:35.537064 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-Project-Domain-Id: default Aug 09 06:56:35.537064 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-Project-Domain-Name: Default Aug 09 06:56:35.537064 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-Project-Id: 489e2c3ffdae42c6a83d2b2655912ea9 Aug 09 06:56:35.537064 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-Project-Name: admin Aug 09 06:56:35.537064 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-Role: reader,admin,member Aug 09 06:56:35.537064 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-Roles: reader,admin,member Aug 09 06:56:35.538590 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/489e2c3ffdae42c6a83d2b2655912ea9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_489e2c3ffdae42c6a83d2b2655912ea9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/489e2c3ffdae42c6a83d2b2655912ea9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/489e2c3ffdae42c6a83d2b2655912ea9"}]}] Aug 09 06:56:35.538590 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-Tenant: admin Aug 09 06:56:35.538590 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-Tenant-Id: 489e2c3ffdae42c6a83d2b2655912ea9 Aug 09 06:56:35.538590 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-Tenant-Name: admin Aug 09 06:56:35.538590 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-User: admin Aug 09 06:56:35.538590 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-User-Domain-Id: default Aug 09 06:56:35.538590 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-User-Domain-Name: Default Aug 09 06:56:35.538590 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-User-Id: b26927358e664fe3981d02119bbe804c Aug 09 06:56:35.538590 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-User-Name: admin Aug 09 06:56:35.538590 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: method: > Aug 09 06:56:35.538590 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: exception: Flavor 84 could not be found. Aug 09 06:56:35.538590 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: action_args: {'id': '84'} Aug 09 06:56:35.538590 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 06:56:35.538590 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 06:56:35.539513 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 06:56:35.539513 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 06:56:35.539513 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 06:56:35.539513 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 06:56:35.539513 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 06:56:35.539513 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 06:56:35.539513 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 06:56:35.539513 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 06:56:35.539513 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 06:56:35.539513 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 06:56:35.539513 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 06:56:35.539513 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 06:56:35.539513 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 09 06:56:35.539513 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Aug 09 06:56:35.539513 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 06:56:35.539513 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Aug 09 06:56:35.539513 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 06:56:35.539513 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 06:56:35.539513 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 06:56:35.541235 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 06:56:35.541235 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 06:56:35.541235 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 06:56:35.541235 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 06:56:35.541235 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 06:56:35.541235 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 06:56:35.541235 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 09 06:56:35.541235 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Aug 09 06:56:35.541235 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 06:56:35.541235 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Aug 09 06:56:35.541235 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 06:56:35.541235 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 06:56:35.541235 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 06:56:35.541235 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 06:56:35.541235 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 06:56:35.541235 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 09 06:56:35.541235 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Aug 09 06:56:35.541235 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-a0793f06-c11d-4a21-9f0c-58ace982ce38 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103147) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 06:56:35.542461 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-a0793f06-c11d-4a21-9f0c-58ace982ce38 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.394420 Aug 09 06:56:35.542461 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 23/44] 10.222.0.30 () {60 vars in 1190 bytes} [Tue Aug 9 06:56:35 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 06:56:35.548996 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-abd989a5-9cce-43fb-9db9-8c408ac2d739 admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 06:56:35.563749 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-abd989a5-9cce-43fb-9db9-8c408ac2d739 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018240 Aug 09 06:56:35.564210 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 22/45] 10.222.0.30 () {60 vars in 1210 bytes} [Tue Aug 9 06:56:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 06:56:35.574146 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-d386cc06-39c7-4535-a392-193ba9bd96ac admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 06:56:35.589603 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-d386cc06-39c7-4535-a392-193ba9bd96ac admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019647 Aug 09 06:56:35.590138 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 24/46] 10.222.0.30 () {60 vars in 1210 bytes} [Tue Aug 9 06:56:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 06:56:35.599191 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-59a35542-52f6-4116-a1e6-e1fe322ba13f admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 06:56:35.604705 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.wsgi [None req-59a35542-52f6-4116-a1e6-e1fe322ba13f admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 09 06:56:35.606198 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-59a35542-52f6-4116-a1e6-e1fe322ba13f admin admin] Request method failure captured: Aug 09 06:56:35.606198 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 09 06:56:35.606198 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: Accept: application/json Aug 09 06:56:35.606198 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: Accept-Encoding: gzip, deflate Aug 09 06:56:35.606198 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: Connection: keep-alive Aug 09 06:56:35.606198 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: Content-Length: 0 Aug 09 06:56:35.606198 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: Host: 10.222.0.30 Aug 09 06:56:35.606198 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: Openstack-Api-Version: compute 2.90 Aug 09 06:56:35.606198 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: Openstack-System-Scope: None Aug 09 06:56:35.606198 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: User-Agent: python-novaclient Aug 09 06:56:35.606198 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-Auth-Token: gAAAAABi8gUijIFQV-HwMdJLGcwWA6-169hia5OJHwmEyjMUxXmxiPsxRHJJnGk9wSI4uWrUdVE9Hnw3DBoNcTYifWRAqkjjp9Z-edqdZKjbFtuSkfvMi9GJ5Ay5DO5OL2wbBu9J6OEzBdLrwfc1Uzk-uNTeRfPcj5nDo3rZ7tctFpXauA4bsmM Aug 09 06:56:35.606198 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-Domain-Id: None Aug 09 06:56:35.606198 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-Domain-Name: None Aug 09 06:56:35.606198 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-Identity-Status: Confirmed Aug 09 06:56:35.606198 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-Is-Admin-Project: True Aug 09 06:56:35.606198 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 06:56:35.606198 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-Project-Domain-Id: default Aug 09 06:56:35.606198 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-Project-Domain-Name: Default Aug 09 06:56:35.606198 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-Project-Id: 489e2c3ffdae42c6a83d2b2655912ea9 Aug 09 06:56:35.606198 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-Project-Name: admin Aug 09 06:56:35.606198 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-Role: reader,admin,member Aug 09 06:56:35.606198 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-Roles: reader,admin,member Aug 09 06:56:35.607708 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/489e2c3ffdae42c6a83d2b2655912ea9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_489e2c3ffdae42c6a83d2b2655912ea9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/489e2c3ffdae42c6a83d2b2655912ea9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/489e2c3ffdae42c6a83d2b2655912ea9"}]}] Aug 09 06:56:35.607708 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-Tenant: admin Aug 09 06:56:35.607708 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-Tenant-Id: 489e2c3ffdae42c6a83d2b2655912ea9 Aug 09 06:56:35.607708 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-Tenant-Name: admin Aug 09 06:56:35.607708 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-User: admin Aug 09 06:56:35.607708 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-User-Domain-Id: default Aug 09 06:56:35.607708 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-User-Domain-Name: Default Aug 09 06:56:35.607708 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-User-Id: b26927358e664fe3981d02119bbe804c Aug 09 06:56:35.607708 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-User-Name: admin Aug 09 06:56:35.607708 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: method: > Aug 09 06:56:35.607708 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: exception: Flavor 84 could not be found. Aug 09 06:56:35.607708 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: action_args: {'id': '84'} Aug 09 06:56:35.607708 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 06:56:35.607708 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 06:56:35.608759 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 06:56:35.608759 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 06:56:35.608759 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 06:56:35.608759 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 06:56:35.608759 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 06:56:35.608759 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 06:56:35.608759 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 06:56:35.608759 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 06:56:35.608759 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 06:56:35.608759 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 06:56:35.608759 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 06:56:35.608759 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 06:56:35.608759 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 09 06:56:35.608759 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Aug 09 06:56:35.608759 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 06:56:35.608759 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Aug 09 06:56:35.608759 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 06:56:35.608759 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 06:56:35.608759 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 06:56:35.610132 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 06:56:35.610132 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 06:56:35.610132 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 06:56:35.610132 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 06:56:35.610132 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 06:56:35.610132 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 06:56:35.610132 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 09 06:56:35.610132 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Aug 09 06:56:35.610132 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 06:56:35.610132 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Aug 09 06:56:35.610132 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 06:56:35.610132 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 06:56:35.610132 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 06:56:35.610132 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 06:56:35.610132 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 06:56:35.610132 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 09 06:56:35.610132 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Aug 09 06:56:35.610132 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-59a35542-52f6-4116-a1e6-e1fe322ba13f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103148) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 06:56:35.611370 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-59a35542-52f6-4116-a1e6-e1fe322ba13f admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011961 Aug 09 06:56:35.611370 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 23/47] 10.222.0.30 () {60 vars in 1190 bytes} [Tue Aug 9 06:56:35 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 09 06:56:36.566120 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-d386cc06-39c7-4535-a392-193ba9bd96ac admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 06:56:36.567155 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-d386cc06-39c7-4535-a392-193ba9bd96ac admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Aug 09 06:56:36.567542 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 25/48] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Aug 9 06:56:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 06:56:37.085282 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-4d9d1136-5a9f-4bf6-8499-1f303d40c1fc admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 06:56:37.091045 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.wsgi [None req-4d9d1136-5a9f-4bf6-8499-1f303d40c1fc admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 09 06:56:37.092556 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-4d9d1136-5a9f-4bf6-8499-1f303d40c1fc admin admin] Request method failure captured: Aug 09 06:56:37.092556 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 09 06:56:37.092556 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: Accept: application/json Aug 09 06:56:37.092556 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: Accept-Encoding: gzip, deflate Aug 09 06:56:37.092556 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: Connection: keep-alive Aug 09 06:56:37.092556 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: Content-Length: 0 Aug 09 06:56:37.092556 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: Host: 10.222.0.30 Aug 09 06:56:37.092556 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: Openstack-Api-Version: compute 2.90 Aug 09 06:56:37.092556 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: Openstack-System-Scope: None Aug 09 06:56:37.092556 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: User-Agent: python-novaclient Aug 09 06:56:37.092556 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-Auth-Token: gAAAAABi8gUk1FiuybfP373yrIfyhd3EJ3pSX63T7RIUEnamFF9K1DptJnf-GvYq5y270yMTSNOydOno_wZRx7YighRRxbygAvgvWaKkhMfJyGTYQgkEhM_RBN4hKPXRvEzoRD-i3BEepfDs1pbhYYk4PLc2zcpU_BcrU4X16SAQjIe68-rkxy0 Aug 09 06:56:37.092556 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-Domain-Id: None Aug 09 06:56:37.092556 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-Domain-Name: None Aug 09 06:56:37.092556 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-Identity-Status: Confirmed Aug 09 06:56:37.092556 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-Is-Admin-Project: True Aug 09 06:56:37.092556 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 06:56:37.092556 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-Project-Domain-Id: default Aug 09 06:56:37.092556 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-Project-Domain-Name: Default Aug 09 06:56:37.092556 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-Project-Id: 489e2c3ffdae42c6a83d2b2655912ea9 Aug 09 06:56:37.092556 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-Project-Name: admin Aug 09 06:56:37.092556 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-Role: reader,admin,member Aug 09 06:56:37.092556 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-Roles: reader,admin,member Aug 09 06:56:37.094350 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/489e2c3ffdae42c6a83d2b2655912ea9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_489e2c3ffdae42c6a83d2b2655912ea9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/489e2c3ffdae42c6a83d2b2655912ea9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/489e2c3ffdae42c6a83d2b2655912ea9"}]}] Aug 09 06:56:37.094350 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-Tenant: admin Aug 09 06:56:37.094350 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-Tenant-Id: 489e2c3ffdae42c6a83d2b2655912ea9 Aug 09 06:56:37.094350 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-Tenant-Name: admin Aug 09 06:56:37.094350 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-User: admin Aug 09 06:56:37.094350 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-User-Domain-Id: default Aug 09 06:56:37.094350 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-User-Domain-Name: Default Aug 09 06:56:37.094350 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-User-Id: b26927358e664fe3981d02119bbe804c Aug 09 06:56:37.094350 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: X-User-Name: admin Aug 09 06:56:37.094350 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: method: > Aug 09 06:56:37.094350 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: exception: Flavor 451 could not be found. Aug 09 06:56:37.094350 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: action_args: {'id': '451'} Aug 09 06:56:37.094350 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 06:56:37.094350 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 06:56:37.095187 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 06:56:37.095187 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 06:56:37.095187 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 06:56:37.095187 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 06:56:37.095187 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 06:56:37.095187 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 06:56:37.095187 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 06:56:37.095187 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 06:56:37.095187 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 06:56:37.095187 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 06:56:37.095187 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 06:56:37.095187 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 06:56:37.095187 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 09 06:56:37.095187 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Aug 09 06:56:37.095187 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 06:56:37.095187 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Aug 09 06:56:37.095187 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 06:56:37.095187 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 06:56:37.095187 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 06:56:37.096379 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 06:56:37.096379 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 06:56:37.096379 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 06:56:37.096379 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 06:56:37.096379 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 06:56:37.096379 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 06:56:37.096379 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 09 06:56:37.096379 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Aug 09 06:56:37.096379 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 06:56:37.096379 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Aug 09 06:56:37.096379 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 06:56:37.096379 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 06:56:37.096379 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 06:56:37.096379 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 06:56:37.096379 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 06:56:37.096379 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 09 06:56:37.096379 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: ERROR nova.api.openstack.wsgi Aug 09 06:56:37.096379 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-4d9d1136-5a9f-4bf6-8499-1f303d40c1fc admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103148) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 06:56:37.097418 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-4d9d1136-5a9f-4bf6-8499-1f303d40c1fc admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.386121 Aug 09 06:56:37.097418 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 24/49] 10.222.0.30 () {60 vars in 1193 bytes} [Tue Aug 9 06:56:36 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 387 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 06:56:37.104206 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-b45eba9f-ed51-4ece-970b-5631e1d6bf0a admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 06:56:37.120337 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-b45eba9f-ed51-4ece-970b-5631e1d6bf0a admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020424 Aug 09 06:56:37.120865 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 26/50] 10.222.0.30 () {60 vars in 1210 bytes} [Tue Aug 9 06:56:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 06:56:37.130503 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-32c1d8eb-658f-4295-8b5e-0c23ace0d6b2 admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 06:56:37.145590 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-32c1d8eb-658f-4295-8b5e-0c23ace0d6b2 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018644 Aug 09 06:56:37.146114 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 25/51] 10.222.0.30 () {60 vars in 1210 bytes} [Tue Aug 9 06:56:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 06:56:37.155440 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-1bddf857-e0ab-483f-9a63-c51a6fcfef54 admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 06:56:37.160742 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.wsgi [None req-1bddf857-e0ab-483f-9a63-c51a6fcfef54 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 09 06:56:37.162219 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-1bddf857-e0ab-483f-9a63-c51a6fcfef54 admin admin] Request method failure captured: Aug 09 06:56:37.162219 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 09 06:56:37.162219 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: Accept: application/json Aug 09 06:56:37.162219 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: Accept-Encoding: gzip, deflate Aug 09 06:56:37.162219 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: Connection: keep-alive Aug 09 06:56:37.162219 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: Content-Length: 0 Aug 09 06:56:37.162219 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: Host: 10.222.0.30 Aug 09 06:56:37.162219 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: Openstack-Api-Version: compute 2.90 Aug 09 06:56:37.162219 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: Openstack-System-Scope: None Aug 09 06:56:37.162219 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: User-Agent: python-novaclient Aug 09 06:56:37.162219 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-Auth-Token: gAAAAABi8gUk1FiuybfP373yrIfyhd3EJ3pSX63T7RIUEnamFF9K1DptJnf-GvYq5y270yMTSNOydOno_wZRx7YighRRxbygAvgvWaKkhMfJyGTYQgkEhM_RBN4hKPXRvEzoRD-i3BEepfDs1pbhYYk4PLc2zcpU_BcrU4X16SAQjIe68-rkxy0 Aug 09 06:56:37.162219 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-Domain-Id: None Aug 09 06:56:37.162219 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-Domain-Name: None Aug 09 06:56:37.162219 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-Identity-Status: Confirmed Aug 09 06:56:37.162219 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-Is-Admin-Project: True Aug 09 06:56:37.162219 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-Openstack-Nova-Api-Version: 2.90 Aug 09 06:56:37.162219 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-Project-Domain-Id: default Aug 09 06:56:37.162219 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-Project-Domain-Name: Default Aug 09 06:56:37.162219 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-Project-Id: 489e2c3ffdae42c6a83d2b2655912ea9 Aug 09 06:56:37.162219 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-Project-Name: admin Aug 09 06:56:37.162219 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-Role: reader,admin,member Aug 09 06:56:37.162219 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-Roles: reader,admin,member Aug 09 06:56:37.163758 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/489e2c3ffdae42c6a83d2b2655912ea9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_489e2c3ffdae42c6a83d2b2655912ea9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/489e2c3ffdae42c6a83d2b2655912ea9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/489e2c3ffdae42c6a83d2b2655912ea9"}]}] Aug 09 06:56:37.163758 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-Tenant: admin Aug 09 06:56:37.163758 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-Tenant-Id: 489e2c3ffdae42c6a83d2b2655912ea9 Aug 09 06:56:37.163758 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-Tenant-Name: admin Aug 09 06:56:37.163758 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-User: admin Aug 09 06:56:37.163758 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-User-Domain-Id: default Aug 09 06:56:37.163758 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-User-Domain-Name: Default Aug 09 06:56:37.163758 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-User-Id: b26927358e664fe3981d02119bbe804c Aug 09 06:56:37.163758 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: X-User-Name: admin Aug 09 06:56:37.163758 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: method: > Aug 09 06:56:37.163758 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: exception: Flavor 451 could not be found. Aug 09 06:56:37.163758 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: action_args: {'id': '451'} Aug 09 06:56:37.163758 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 06:56:37.163758 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 06:56:37.164612 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 09 06:56:37.164612 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 09 06:56:37.164612 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 09 06:56:37.164612 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 09 06:56:37.164612 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 06:56:37.164612 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 06:56:37.164612 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 09 06:56:37.164612 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 09 06:56:37.164612 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 09 06:56:37.164612 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 06:56:37.164612 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 09 06:56:37.164612 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 09 06:56:37.164612 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 09 06:56:37.164612 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Aug 09 06:56:37.164612 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 06:56:37.164612 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Aug 09 06:56:37.164612 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 06:56:37.164612 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 06:56:37.164612 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 06:56:37.166222 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 06:56:37.166222 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 06:56:37.166222 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 06:56:37.166222 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 06:56:37.166222 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 09 06:56:37.166222 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 09 06:56:37.166222 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 09 06:56:37.166222 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Aug 09 06:56:37.166222 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 06:56:37.166222 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Aug 09 06:56:37.166222 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 06:56:37.166222 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 06:56:37.166222 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 06:56:37.166222 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 06:56:37.166222 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 06:56:37.166222 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 09 06:56:37.166222 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: ERROR nova.api.openstack.wsgi Aug 09 06:56:37.166222 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-1bddf857-e0ab-483f-9a63-c51a6fcfef54 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103147) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 06:56:37.167328 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-1bddf857-e0ab-483f-9a63-c51a6fcfef54 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011703 Aug 09 06:56:37.167328 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 27/52] 10.222.0.30 () {60 vars in 1193 bytes} [Tue Aug 9 06:56:37 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 09 06:56:38.121375 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-32c1d8eb-658f-4295-8b5e-0c23ace0d6b2 admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 06:56:38.122379 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-32c1d8eb-658f-4295-8b5e-0c23ace0d6b2 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Aug 09 06:56:38.122781 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 26/53] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Aug 9 06:56:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 06:56:38.650274 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-d61a92aa-4b78-4893-9820-fec5664b279f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 06:56:38.670859 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-d61a92aa-4b78-4893-9820-fec5664b279f admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.404184 Aug 09 06:56:38.671401 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 28/54] 10.222.0.30 () {64 vars in 1235 bytes} [Tue Aug 9 06:56:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 06:56:39.643311 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-32c1d8eb-658f-4295-8b5e-0c23ace0d6b2 admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 06:56:39.644344 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-32c1d8eb-658f-4295-8b5e-0c23ace0d6b2 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Aug 09 06:56:39.644733 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 27/55] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Aug 9 06:56:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 06:56:40.159555 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-dbed4796-b8c3-49d7-8649-43c3018dd7a1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 06:56:40.178205 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-dbed4796-b8c3-49d7-8649-43c3018dd7a1 admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.395287 Aug 09 06:56:40.178747 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 29/56] 10.222.0.30 () {64 vars in 1235 bytes} [Tue Aug 9 06:56:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 09 06:56:41.143710 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-32c1d8eb-658f-4295-8b5e-0c23ace0d6b2 admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 06:56:41.144728 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-32c1d8eb-658f-4295-8b5e-0c23ace0d6b2 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Aug 09 06:56:41.145101 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 28/57] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Aug 9 06:56:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 06:56:41.668441 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-e2d78df5-b890-43fd-8f1c-12b4e529275f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 06:56:41.688080 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-e2d78df5-b890-43fd-8f1c-12b4e529275f admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.401350 Aug 09 06:56:41.688637 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 30/58] 10.222.0.30 () {64 vars in 1235 bytes} [Tue Aug 9 06:56:41 2022] POST /compute/v2.1/flavors => generated 407 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 06:56:42.659398 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-32c1d8eb-658f-4295-8b5e-0c23ace0d6b2 admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 06:56:42.660426 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-32c1d8eb-658f-4295-8b5e-0c23ace0d6b2 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Aug 09 06:56:42.660818 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 29/59] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Aug 9 06:56:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 06:56:43.178164 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-5900183d-0041-4f0b-b263-402a90f9824e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 06:56:43.196764 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-5900183d-0041-4f0b-b263-402a90f9824e admin admin] 10.222.0.30 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.396543 Aug 09 06:56:43.197335 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 31/60] 10.222.0.30 () {64 vars in 1235 bytes} [Tue Aug 9 06:56:42 2022] POST /compute/v2.1/flavors => generated 409 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 06:56:44.169741 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-32c1d8eb-658f-4295-8b5e-0c23ace0d6b2 admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 06:56:44.170772 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-32c1d8eb-658f-4295-8b5e-0c23ace0d6b2 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Aug 09 06:56:44.171166 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 30/61] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Aug 9 06:56:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 06:56:44.688851 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-142dda41-cbad-4df8-9022-da78bbd46db6 admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 06:56:44.709829 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-142dda41-cbad-4df8-9022-da78bbd46db6 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.400661 Aug 09 06:56:44.710409 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 32/62] 10.222.0.30 () {60 vars in 1202 bytes} [Tue Aug 9 06:56:44 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 06:57:36.070204 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-32c1d8eb-658f-4295-8b5e-0c23ace0d6b2 admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 06:57:36.071206 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-32c1d8eb-658f-4295-8b5e-0c23ace0d6b2 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Aug 09 06:57:36.071650 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 31/63] 10.222.0.30 () {54 vars in 931 bytes} [Tue Aug 9 06:57:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 06:57:36.082110 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG dbcounter [-] [103147] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:36.458511 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-183d0917-d96e-4a67-8586-7d8bb5b15378 admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 06:57:36.479498 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-183d0917-d96e-4a67-8586-7d8bb5b15378 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.401550 Aug 09 06:57:36.480064 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 33/64] 10.222.0.30 () {60 vars in 1292 bytes} [Tue Aug 9 06:57:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 06:57:36.503487 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-b59679cb-8167-4b17-a4cb-dbf1d2f90c0c admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 06:57:36.506966 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG dbcounter [-] [103148] Writing DB stats nova_api:SELECT=14 {{(pid=103148) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 06:57:36.512220 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-b59679cb-8167-4b17-a4cb-dbf1d2f90c0c admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012595 Aug 09 06:57:36.512726 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 32/65] 10.222.0.30 () {60 vars in 1283 bytes} [Tue Aug 9 06:57:36 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 06:57:36.524086 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-9c76e7fd-6003-495b-9da7-b35303c17abf admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 06:57:36.531918 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-9c76e7fd-6003-495b-9da7-b35303c17abf admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011396 Aug 09 06:57:36.532425 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 34/66] 10.222.0.30 () {60 vars in 1286 bytes} [Tue Aug 9 06:57:36 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 06:57:36.543847 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-bec42721-1944-4177-8101-53c12002c294 admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 06:57:36.551402 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-bec42721-1944-4177-8101-53c12002c294 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011597 Aug 09 06:57:36.551943 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 33/67] 10.222.0.30 () {60 vars in 1286 bytes} [Tue Aug 9 06:57:36 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 06:57:36.563674 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-109a34ce-9791-4bec-90a2-eba2ef5d3fa3 admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 06:57:36.571103 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-109a34ce-9791-4bec-90a2-eba2ef5d3fa3 admin admin] 10.222.0.30 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011086 Aug 09 06:57:36.571626 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 35/68] 10.222.0.30 () {60 vars in 1283 bytes} [Tue Aug 9 06:57:36 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:00:30.521521 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-bec42721-1944-4177-8101-53c12002c294 admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:00:30.522532 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-bec42721-1944-4177-8101-53c12002c294 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Aug 09 07:00:30.522921 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 34/69] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Aug 9 07:00:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:00:30.667466 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG dbcounter [-] [103147] Writing DB stats nova_api:SELECT=6 {{(pid=103147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:00:30.830849 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-a0327b42-ff24-4459-b084-22674710d43e admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:00:30.833262 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 07:00:30.833262 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: warnings.warn(msg) Aug 09 07:00:30.834386 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-a0327b42-ff24-4459-b084-22674710d43e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:00:30.834864 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-a0327b42-ff24-4459-b084-22674710d43e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:00:30.835295 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-a0327b42-ff24-4459-b084-22674710d43e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:00:30.836061 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-a0327b42-ff24-4459-b084-22674710d43e admin admin] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:00:30.836509 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-a0327b42-ff24-4459-b084-22674710d43e admin admin] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:00:30.836930 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-a0327b42-ff24-4459-b084-22674710d43e admin admin] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:00:30.871470 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-a0327b42-ff24-4459-b084-22674710d43e admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.205507 Aug 09 07:00:30.872733 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 36/70] 10.222.0.30 () {60 vars in 1193 bytes} [Tue Aug 9 07:00:30 2022] GET /compute/v2.1/os-services => generated 791 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 07:00:31.696389 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-bec42721-1944-4177-8101-53c12002c294 admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:00:31.697399 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-bec42721-1944-4177-8101-53c12002c294 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Aug 09 07:00:31.697791 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 35/71] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Aug 9 07:00:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:00:31.891685 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-032b5a39-2dc6-40ba-b660-509208bbebb5 admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:00:31.894716 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 07:00:31.894716 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: warnings.warn(msg) Aug 09 07:00:31.896009 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-032b5a39-2dc6-40ba-b660-509208bbebb5 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:00:31.896495 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-032b5a39-2dc6-40ba-b660-509208bbebb5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:00:31.896927 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-032b5a39-2dc6-40ba-b660-509208bbebb5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:00:31.897646 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-032b5a39-2dc6-40ba-b660-509208bbebb5 admin admin] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:00:31.898095 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-032b5a39-2dc6-40ba-b660-509208bbebb5 admin admin] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:00:31.898513 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-032b5a39-2dc6-40ba-b660-509208bbebb5 admin admin] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:00:31.918060 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-032b5a39-2dc6-40ba-b660-509208bbebb5 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.080753 Aug 09 07:00:31.918713 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 37/72] 10.222.0.30 () {60 vars in 1193 bytes} [Tue Aug 9 07:00:31 2022] GET /compute/v2.1/os-services => generated 791 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 07:00:43.167083 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-bec42721-1944-4177-8101-53c12002c294 admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:00:43.168146 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-bec42721-1944-4177-8101-53c12002c294 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Aug 09 07:00:43.168547 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 36/73] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Aug 9 07:00:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:00:43.313045 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG dbcounter [-] [103147] Writing DB stats nova_cell0:SELECT=4 {{(pid=103147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:00:43.313758 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG dbcounter [-] [103147] Writing DB stats nova_cell1:SELECT=4 {{(pid=103147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:00:43.314428 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG dbcounter [-] [103147] Writing DB stats nova_api:SELECT=8 {{(pid=103147) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:00:43.362475 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-a91b3f57-c8aa-47a8-8e8a-dd67eeb771df admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:00:43.365002 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 07:00:43.365002 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: warnings.warn(msg) Aug 09 07:00:43.366173 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-a91b3f57-c8aa-47a8-8e8a-dd67eeb771df admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:00:43.366670 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-a91b3f57-c8aa-47a8-8e8a-dd67eeb771df admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:00:43.367094 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-a91b3f57-c8aa-47a8-8e8a-dd67eeb771df admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:00:43.367927 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-a91b3f57-c8aa-47a8-8e8a-dd67eeb771df admin admin] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:00:43.368367 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-a91b3f57-c8aa-47a8-8e8a-dd67eeb771df admin admin] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:00:43.368780 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-a91b3f57-c8aa-47a8-8e8a-dd67eeb771df admin admin] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:00:43.396601 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-a91b3f57-c8aa-47a8-8e8a-dd67eeb771df admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.088625 Aug 09 07:00:43.397173 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 38/74] 10.222.0.30 () {60 vars in 1193 bytes} [Tue Aug 9 07:00:43 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:00:44.232710 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: DEBUG nova.api.openstack.wsgi [None req-bec42721-1944-4177-8101-53c12002c294 admin admin] Calling method '>' {{(pid=103148) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:00:44.233773 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: INFO nova.api.openstack.requestlog [None req-bec42721-1944-4177-8101-53c12002c294 admin admin] 10.222.0.30 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Aug 09 07:00:44.234201 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: [pid: 103148|app: 0|req: 37/75] 10.222.0.30 () {56 vars in 1074 bytes} [Tue Aug 9 07:00:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:00:44.425410 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG nova.api.openstack.wsgi [None req-d315475e-1407-42ca-95e6-136515c86839 admin admin] Calling method '>' {{(pid=103147) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:00:44.427819 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 09 07:00:44.427819 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: warnings.warn(msg) Aug 09 07:00:44.428933 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-d315475e-1407-42ca-95e6-136515c86839 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:00:44.429411 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-d315475e-1407-42ca-95e6-136515c86839 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:00:44.429843 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-d315475e-1407-42ca-95e6-136515c86839 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:00:44.430560 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-d315475e-1407-42ca-95e6-136515c86839 admin admin] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:00:44.431007 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-d315475e-1407-42ca-95e6-136515c86839 admin admin] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:00:44.431423 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: DEBUG oslo_concurrency.lockutils [None req-d315475e-1407-42ca-95e6-136515c86839 admin admin] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103147) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:00:44.454199 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: INFO nova.api.openstack.requestlog [None req-d315475e-1407-42ca-95e6-136515c86839 admin admin] 10.222.0.30 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.080087 Aug 09 07:00:44.454688 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: [pid: 103147|app: 0|req: 39/76] 10.222.0.30 () {60 vars in 1193 bytes} [Tue Aug 9 07:00:44 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:01:39.910204 dv-cinder-852514-1-iscsi devstack@n-api.service[103146]: Tue Aug 9 07:01:39 2022 - graceful shutdown triggered... Aug 09 07:01:39.910714 dv-cinder-852514-1-iscsi devstack@n-api.service[103148]: Gracefully killing worker 2 (pid: 103148)... Aug 09 07:01:39.910328 dv-cinder-852514-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 09 07:01:39.912465 dv-cinder-852514-1-iscsi devstack@n-api.service[103147]: Gracefully killing worker 1 (pid: 103147)... Aug 09 07:01:40.911343 dv-cinder-852514-1-iscsi devstack@n-api.service[103146]: worker 1 buried after 1 seconds Aug 09 07:01:40.911812 dv-cinder-852514-1-iscsi devstack@n-api.service[103146]: worker 2 buried after 1 seconds Aug 09 07:01:40.911812 dv-cinder-852514-1-iscsi devstack@n-api.service[103146]: goodbye to uWSGI. Aug 09 07:01:40.912961 dv-cinder-852514-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 09 07:01:40.913514 dv-cinder-852514-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 09 07:01:40.916365 dv-cinder-852514-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 09 07:01:40.926137 dv-cinder-852514-1-iscsi devstack@n-api.service[117840]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 09 07:01:40.928156 dv-cinder-852514-1-iscsi devstack@n-api.service[117840]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 9 07:01:40 2022] *** Aug 09 07:01:40.928156 dv-cinder-852514-1-iscsi devstack@n-api.service[117840]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 09 07:01:40.928156 dv-cinder-852514-1-iscsi devstack@n-api.service[117840]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 09 07:01:40.928156 dv-cinder-852514-1-iscsi devstack@n-api.service[117840]: nodename: dv-cinder-852514-1-iscsi Aug 09 07:01:40.928156 dv-cinder-852514-1-iscsi devstack@n-api.service[117840]: machine: x86_64 Aug 09 07:01:40.928156 dv-cinder-852514-1-iscsi devstack@n-api.service[117840]: clock source: unix Aug 09 07:01:40.928156 dv-cinder-852514-1-iscsi devstack@n-api.service[117840]: pcre jit disabled Aug 09 07:01:40.928156 dv-cinder-852514-1-iscsi devstack@n-api.service[117840]: detected number of CPU cores: 4 Aug 09 07:01:40.928156 dv-cinder-852514-1-iscsi devstack@n-api.service[117840]: current working directory: / Aug 09 07:01:40.928156 dv-cinder-852514-1-iscsi devstack@n-api.service[117840]: detected binary path: /usr/bin/uwsgi-core Aug 09 07:01:40.928156 dv-cinder-852514-1-iscsi devstack@n-api.service[117840]: your processes number limit is 47680 Aug 09 07:01:40.928868 dv-cinder-852514-1-iscsi devstack@n-api.service[117840]: your memory page size is 4096 bytes Aug 09 07:01:40.928868 dv-cinder-852514-1-iscsi devstack@n-api.service[117840]: detected max file descriptor number: 2048 Aug 09 07:01:40.928868 dv-cinder-852514-1-iscsi devstack@n-api.service[117840]: lock engine: pthread robust mutexes Aug 09 07:01:40.928868 dv-cinder-852514-1-iscsi devstack@n-api.service[117840]: thunder lock: enabled Aug 09 07:01:40.928868 dv-cinder-852514-1-iscsi devstack@n-api.service[117840]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 09 07:01:40.928868 dv-cinder-852514-1-iscsi devstack@n-api.service[117840]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 09 07:01:40.969216 dv-cinder-852514-1-iscsi devstack@n-api.service[117840]: Python main interpreter initialized at 0x55a61eb039c0 Aug 09 07:01:40.969216 dv-cinder-852514-1-iscsi devstack@n-api.service[117840]: python threads support enabled Aug 09 07:01:40.969216 dv-cinder-852514-1-iscsi devstack@n-api.service[117840]: your server socket listen backlog is limited to 100 connections Aug 09 07:01:40.969216 dv-cinder-852514-1-iscsi devstack@n-api.service[117840]: your mercy for graceful operations on workers is 90 seconds Aug 09 07:01:40.969673 dv-cinder-852514-1-iscsi devstack@n-api.service[117840]: mapped 403077 bytes (393 KB) for 2 cores Aug 09 07:01:40.969673 dv-cinder-852514-1-iscsi devstack@n-api.service[117840]: *** Operational MODE: preforking *** Aug 09 07:01:40.969946 dv-cinder-852514-1-iscsi devstack@n-api.service[117840]: *** uWSGI is running in multiple interpreter mode *** Aug 09 07:01:40.969946 dv-cinder-852514-1-iscsi devstack@n-api.service[117840]: spawned uWSGI master process (pid: 117840) Aug 09 07:01:40.970151 dv-cinder-852514-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 09 07:01:40.971097 dv-cinder-852514-1-iscsi devstack@n-api.service[117840]: spawned uWSGI worker 1 (pid: 117858, cores: 1) Aug 09 07:01:40.971097 dv-cinder-852514-1-iscsi devstack@n-api.service[117840]: spawned uWSGI worker 2 (pid: 117859, cores: 1) Aug 09 07:01:40.971286 dv-cinder-852514-1-iscsi devstack@n-api.service[117840]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 09 07:01:41.641081 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 09 07:01:41.641684 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 09 07:01:42.791217 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 07:01:42.791217 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: from cryptography.utils import int_from_bytes Aug 09 07:01:42.791876 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 07:01:42.791876 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: from cryptography.utils import int_from_bytes Aug 09 07:01:42.792015 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 07:01:42.792015 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: from cryptography.utils import int_from_bytes Aug 09 07:01:42.792015 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 09 07:01:42.792015 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: from cryptography.utils import int_from_bytes Aug 09 07:01:45.144501 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 07:01:45.145006 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 07:01:45.145276 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 07:01:45.145633 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 07:01:45.145900 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 07:01:45.146269 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.146591 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.146707 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 09 07:01:45.147098 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 09 07:01:45.147184 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.147184 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.147467 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 09 07:01:45.147579 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.147804 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 09 07:01:45.147921 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.148095 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 09 07:01:45.148219 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.148573 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.148674 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.148755 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.148835 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.149004 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.149114 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.149318 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.149427 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.149639 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852514-1-iscsi {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.149741 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.149958 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.150070 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.150261 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.150362 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.150572 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.150685 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.150884 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.150993 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.151174 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.151283 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.151490 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.151697 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.151874 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.152589 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-852514-1-iscsi {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.152849 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.153010 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.153191 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.154407 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.154660 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.154889 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.155111 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.155333 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.155545 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.155801 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.155801 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.156257 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.156257 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.156710 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.156948 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.157159 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.157376 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.157611 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.157855 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.158077 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.158310 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.158562 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.158781 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.158999 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.159221 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852514-1-iscsi {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.159446 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.159706 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.159891 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.160085 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.160234 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.160387 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.160594 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.160746 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.160909 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.161062 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.161254 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-852514-1-iscsi {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.161405 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.161574 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.161738 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.161886 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.162042 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.162639 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.162808 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.162978 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.163125 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.163281 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.163681 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.163852 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.164001 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.164154 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.164300 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.164444 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.164597 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.164755 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.164910 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.164910 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.165516 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.165985 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.166166 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.166573 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.166729 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.166891 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.167045 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.167199 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.167354 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.167517 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.167734 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.167886 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.168030 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.168187 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.168349 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.168515 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.168665 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.168818 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.168973 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.169120 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.169276 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.169430 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.169584 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.169731 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.169883 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.170038 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.170195 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.170340 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.170492 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.170649 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.170804 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.170964 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.171117 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.171272 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.171417 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.171568 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.171749 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.172906 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.173096 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.173257 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.173412 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.173412 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.174125 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.174275 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.174427 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.174580 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.174735 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.174882 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.175044 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.175191 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.175472 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.175718 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.175884 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.176048 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.176196 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.176341 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.176494 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.176639 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.176794 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.176954 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.177107 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.177254 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.177413 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.177582 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.30 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.177783 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.177949 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.30 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.178097 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.178241 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.178393 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.178547 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.178704 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.178872 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.179019 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.179163 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.179315 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.179467 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.179732 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.179893 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.180047 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.180047 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.180332 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.180478 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.180636 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.180790 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.180935 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.181087 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.181233 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.181385 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.181543 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.181712 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.181866 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.182019 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.182165 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.182310 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.182468 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.182639 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.183775 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.184237 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.184394 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.184540 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.184701 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.184850 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.185007 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.185197 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.185359 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.185602 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.185756 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.185910 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.186063 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.186208 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.186352 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.186510 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.186668 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.186822 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.186988 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.187141 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.187286 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.187454 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.187633 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.187943 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.188103 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.188256 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.188402 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.188559 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.188712 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.188857 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.189009 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.189175 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.189328 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.189481 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.189625 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.189777 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.189931 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.190078 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.190230 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.190376 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.190529 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.190696 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.190842 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.190985 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.191156 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.191311 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.191455 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.191618 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.191769 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.191914 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.192074 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.192232 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.192377 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.192521 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.192665 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.192827 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.193384 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.193545 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.193691 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.193844 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.193990 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.194421 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.194586 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.194742 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.194896 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.195043 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.195196 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.195354 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.195500 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.195758 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.195931 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.196078 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.196231 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.196391 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.196558 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.196712 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.196865 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.197011 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.197163 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.197334 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.197484 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.197628 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.197779 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.197989 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.198148 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.198308 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.198471 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.198619 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.198778 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.199711 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.199878 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.200025 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.200170 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.200323 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.200478 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.200644 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.200804 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 09 07:01:45.200959 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.200959 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.201243 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.201389 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.201540 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.201703 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.201850 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.202002 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.202148 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.202300 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.202452 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.202622 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.202776 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.202929 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.203479 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.203663 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.203825 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.203972 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.204128 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.204572 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.204739 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.204895 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.205055 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.205222 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.205377 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.205530 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.205675 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.205908 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.206068 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.206227 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.206382 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.206535 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.206689 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.206842 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.206989 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.207144 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.207306 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.207458 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.207685 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.207838 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.208029 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.208195 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.208349 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.208495 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.208639 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.208791 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.209021 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.209182 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.209421 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.209571 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.209726 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.209880 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.210036 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.210190 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.210344 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.210497 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.210650 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.210803 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.210957 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.210957 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.211250 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.211416 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.211570 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.211739 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.211897 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.212050 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.212207 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.212638 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.212794 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.212950 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.213097 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.213855 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.214012 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.214159 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.214321 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.214579 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.214857 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.215102 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.215255 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.215400 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.215545 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.215724 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.215889 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.216124 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.216276 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.216430 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.216577 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.216746 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.216904 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.217057 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.217202 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.217367 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.217521 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.217680 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.217827 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.217971 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.218161 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.218311 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.218467 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.218613 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.218776 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.218976 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.219123 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.219268 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.219426 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.219573 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.219778 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.219926 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.220078 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.220223 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.220413 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.220572 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.220771 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.220928 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.221081 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.221235 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.221390 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.221537 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.221683 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.221827 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.221972 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.222129 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.222284 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.222429 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.222575 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.222738 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.222884 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.223042 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.223188 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.223357 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.223878 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.224045 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.224201 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.224366 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.224522 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.224776 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.225034 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.225295 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.225467 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.226302 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.226463 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.226609 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.226762 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.226910 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.227065 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.227224 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.227383 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.227529 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.227724 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.227883 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.228051 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.228248 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.228400 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.228546 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.228698 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.228851 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.229011 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.229165 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.229311 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.229455 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.229600 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.229751 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.229906 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.229906 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.230203 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.230349 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.230494 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.230653 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.230806 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.230960 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.231112 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.231258 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.231402 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.231557 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.231738 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.231894 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.232059 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.232213 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.232364 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.232523 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.232676 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.232822 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.232976 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.233128 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.233281 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.233441 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.233606 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.234092 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.234247 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.234413 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.234574 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.234720 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.234959 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.235217 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.235476 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.235695 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.235865 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.236112 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.236288 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.236511 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.236664 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.236821 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.236976 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.237132 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.237290 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.237436 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.237580 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.237733 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.237890 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.238036 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.238179 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.238373 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.238523 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.238682 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.238840 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.238993 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.239147 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.239293 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.239445 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.239662 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.239819 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.239973 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.240121 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.240266 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.240412 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.240570 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.240724 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.240863 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.240961 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.241086 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.241226 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.241442 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.241586 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.241718 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.241858 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.241990 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.242139 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.242738 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.242879 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.243011 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.243150 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.243283 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.243424 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.243567 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.243730 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.243879 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.244358 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.244492 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.244640 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.244773 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.244912 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.245131 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.245359 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.245517 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.246251 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.246387 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.246531 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.246788 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.246940 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.247074 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.247225 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.247359 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.247490 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.247656 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.247805 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.247954 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.248093 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.248233 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.248410 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.248553 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.248698 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.248841 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.248980 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.249112 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.249250 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.249389 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.249520 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.249661 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.249800 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.249933 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.250064 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.250202 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.250335 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.250480 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.250620 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.250759 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.250892 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.251024 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.251024 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.251287 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.251426 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.251568 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.251718 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.251860 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.252004 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.252137 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.252268 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.252406 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.252537 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.252674 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.252816 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.252955 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.253096 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.253229 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.253367 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.253499 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.253643 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.253775 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.253906 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.254060 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.254783 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.254926 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.255067 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.255291 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.255518 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.255679 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.255822 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.255974 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.256114 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.256269 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.256269 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.256269 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.256754 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.256965 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.256965 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.257236 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.257367 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.257499 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.257637 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.257783 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.257915 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.257915 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.258178 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.258320 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.258320 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.258633 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.258775 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.258914 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.259054 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.259054 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.259326 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.259466 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.259623 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.259758 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.259758 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.260027 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.260173 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.260306 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.260445 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.260576 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.260707 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.260707 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.260964 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.261096 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.261096 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.261921 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.262098 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.262283 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.262429 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.262429 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.262688 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.262827 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.262827 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.263084 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.263247 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.263247 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.263533 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.263705 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.263840 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.263981 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.263981 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.264259 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.264469 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.264469 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.264999 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.265147 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.265296 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.265517 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.265517 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.265872 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.266153 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.266303 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.266435 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.266435 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.266800 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.266948 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.267207 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.267346 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.267479 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.267642 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.267642 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.267912 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.268053 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.268193 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.268332 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.268332 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.268332 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.268758 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.268898 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.269037 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.269168 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.269168 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.269438 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.269570 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.269570 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.269835 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.269973 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.269973 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.270232 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.270371 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.270511 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.270651 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.270651 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.270921 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.271054 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.271054 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.271278 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.271391 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.271391 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.271639 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.271757 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.271951 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.272077 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.272077 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.272305 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.272425 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.272545 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.272658 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.272658 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.272878 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.273363 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.273363 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.273622 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.273890 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.274042 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.274183 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.274317 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.274471 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.274471 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.275084 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.275222 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.275352 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.275498 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.275498 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.275970 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.276124 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.276260 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.276400 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.276400 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.276674 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.276911 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.277627 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.277765 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.277765 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.278030 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.278165 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.278315 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.278447 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.278447 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.278749 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.278889 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.278889 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.279213 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.279348 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.279487 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.279642 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.279642 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.279891 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.280041 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.280041 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.280291 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.280422 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.280422 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.280422 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.280422 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.280422 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.280422 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.280422 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.280422 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.281397 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.281527 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.281658 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.281658 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.281904 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.282035 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.282035 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.282306 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.282439 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.282570 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.282714 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.282714 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.282977 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.283110 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.283248 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.283387 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.283387 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.283659 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.283804 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.283945 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.284083 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.284215 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.284364 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.284364 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.284652 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.284850 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.284850 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.285405 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.285542 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.285542 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.285885 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.286128 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.286270 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.286402 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.286402 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.286661 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.286792 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.286792 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.287136 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.287279 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.287279 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.287547 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.287984 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.287984 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.288236 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.288367 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.288517 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.288660 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.288660 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.288952 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.289088 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.289218 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.289361 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.289361 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.289615 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.289745 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.289745 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.289988 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.290125 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.290255 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.290391 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.290613 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.290769 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.290769 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.291028 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.291169 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.291169 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.291434 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.291574 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.291737 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.292419 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.292419 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.293234 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.293376 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.293517 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.293649 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.293788 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.293922 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.293922 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.294180 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.294533 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.294533 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.294792 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.295025 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.295025 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.295573 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.295723 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.295890 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.296119 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.296119 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.296479 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.296621 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.296754 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.296886 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.296886 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.297170 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.297405 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.297548 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.297691 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.297691 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.298615 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.298812 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.298812 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.299065 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.299198 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.299198 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.299469 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.299696 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.299696 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.299948 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.300091 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.300226 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.300367 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.300507 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.300648 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.300648 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.300905 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.301037 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.301178 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.301312 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.301312 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.301566 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.301699 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.301829 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.301969 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.302110 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.302250 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.302383 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.302514 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.302514 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.302776 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.302907 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.302907 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.303153 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.303284 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.303424 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.303564 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.303715 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.303860 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.303860 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.304164 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.304305 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.304305 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.304555 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.304695 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.304695 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.304951 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.305187 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.305877 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.306018 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.306018 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.306374 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.306606 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.306606 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.307823 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.307981 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.308214 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.308353 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.308501 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.308637 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.308637 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.308938 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.309072 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.309213 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.309472 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.309472 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.309730 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.309871 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.310005 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.310144 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.310286 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.310419 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.310419 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.310676 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.310810 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.310950 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.311083 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.311222 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.311364 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.311505 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.311653 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.311801 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.311801 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.312060 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.312200 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.312332 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.312471 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.312617 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.312760 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.312900 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.313034 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.313166 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.313305 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.313458 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.313593 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.313732 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.313867 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.314007 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.314155 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.314303 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.314447 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.314595 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.314811 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.314957 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.315100 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.315321 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.315464 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.315624 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.316048 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.316188 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.316417 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.316556 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.316794 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.316937 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.317086 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.317216 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.317355 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.317355 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.317604 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.317604 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.317958 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.318109 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.318109 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.318446 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.318576 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.318713 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.318852 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.318852 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.319188 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.319321 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.319321 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.319569 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.319773 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.319773 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.320035 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.320177 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.320177 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.320477 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.320620 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.320620 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.320919 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.321050 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.321050 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.321556 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.321698 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.321698 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.321971 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.322114 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.322114 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.322375 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.322508 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.322640 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.322780 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.322780 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.323030 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.323175 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.323175 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.323428 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.323567 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.323567 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.323863 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.323998 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.323998 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.324247 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.324387 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.324387 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.324646 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.324778 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.324916 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.325059 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.325199 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.325353 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.325353 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.325699 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.326170 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.326323 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.326539 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.326675 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.326831 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.326831 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.327176 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.327309 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.327439 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.327566 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.327832 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.327981 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.328496 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.328633 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.328749 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.328875 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.328875 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.329137 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.329260 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.329373 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.329485 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.329608 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.329722 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.329833 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.329833 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.330055 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.330167 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.330359 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.330475 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.330586 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.330705 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.330817 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.330938 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.331051 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.331163 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.331282 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.331394 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.331506 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.331657 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.331786 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.331928 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.332061 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.332354 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.332483 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.332671 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.332793 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.332982 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.333110 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.333440 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.333588 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.333719 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.333843 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.333997 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.334169 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.334458 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.334607 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.334732 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.334854 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.334988 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.335127 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.335307 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.335452 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.335694 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.335833 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.335981 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.336402 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.336552 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.336776 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.336917 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.337065 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.337281 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.337426 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.337575 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.337708 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.337853 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.337989 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.338128 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.338361 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.338590 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.338734 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.338876 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.339019 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.339203 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.339936 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.339936 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.340217 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.340351 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.340544 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.340544 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.340826 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.340960 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.341094 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.341238 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.341371 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.341511 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.341654 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.341788 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.341927 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.342068 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.342203 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.342334 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.342475 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.342618 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.342751 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.342884 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.343023 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.343166 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.343300 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.343432 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.343563 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.343711 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.343855 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.344004 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.344137 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.344271 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.344417 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.344559 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.344692 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.344839 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.344998 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.345143 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.345334 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.345471 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.345723 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.345884 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.346019 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.346174 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.346572 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.346734 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.346946 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.347083 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.347083 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.347434 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.347573 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.347766 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.347916 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.348051 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.348184 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.348317 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.348566 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.348773 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.348919 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.349062 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.349246 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.349390 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.349526 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.349673 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.349816 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.349959 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.350094 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.350235 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.350369 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.350516 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.350651 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.350790 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.350923 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.351056 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.351188 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.351330 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.351471 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.351629 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.351776 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.351910 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.352049 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.352191 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.352333 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.352474 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.352607 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.352748 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.352889 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.353031 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.353165 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.353297 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.353429 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.353562 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.353737 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.353876 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.354062 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.354208 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.354382 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.354519 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.354691 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.354830 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.355059 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.356353 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.356786 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.356786 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.357145 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.357292 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.357451 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.357666 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.357803 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.357952 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.358094 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.358227 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.358359 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.358491 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.359952 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.360513 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.360650 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.360791 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.360933 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.361077 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.361220 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.361360 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.361494 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.361626 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.361766 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.361974 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.362119 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.362253 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.362395 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.362530 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.362676 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.362810 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.362943 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.363076 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.363216 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.363350 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.363491 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.363649 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.363784 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.363918 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.364050 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.364196 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.364340 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.364473 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.364605 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.364737 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.364737 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.364994 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.365142 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.365277 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.365410 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.365549 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.365690 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.365832 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.365973 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.366140 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.366503 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.366908 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.367055 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.367280 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.367420 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.367563 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.367737 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.367883 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.368121 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.368271 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.368415 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.368552 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.368686 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.368975 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.369126 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.369262 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.369403 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.369537 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.369685 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.369819 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.369819 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.370099 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.370234 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.370374 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.370510 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.370693 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.370915 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.371101 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.371558 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.371739 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.371872 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.372000 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.372116 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.372254 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.372385 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.372523 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.372655 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.372793 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.372925 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.373061 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.373190 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.373304 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.373434 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.373572 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.373728 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.373728 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.374097 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.374240 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.374392 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.374526 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.374660 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.374800 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.374941 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.375073 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.375215 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.375356 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.375496 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.375662 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.375798 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.375930 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.376076 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.376210 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.376356 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.376567 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.376719 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.377122 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.377276 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.377276 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.377616 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.377750 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.377884 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.378030 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.378262 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.378406 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.378540 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.378673 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.378809 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.379111 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.379506 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.379662 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.379797 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.379918 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.380049 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.380196 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.380331 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.380462 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.380594 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.380735 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.380882 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.381024 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.381167 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.381308 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.381441 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.381580 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.381732 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.381732 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.381984 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.382117 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.382248 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.382380 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.382525 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.382666 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.382806 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.382806 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.383065 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.383210 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.383344 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.383476 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.383656 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.383803 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.383938 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.384080 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.384214 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.384354 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.384486 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.384626 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.384758 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.384899 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.385072 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.385217 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.385350 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.385490 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.385632 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.385766 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.385898 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.386037 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.386179 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.386360 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.386668 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.386874 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.387270 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.387410 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.387650 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.387788 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.387953 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.388189 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.388722 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.388866 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.389025 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.389319 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.389473 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.389608 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.389608 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.389875 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.390007 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.390154 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.390295 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.390430 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.390570 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.390703 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.390835 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.391042 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.391177 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.391309 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.391450 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.391583 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.391809 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.391956 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.392099 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.392233 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.392373 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.392516 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.392650 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.392791 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.392925 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.393064 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.393208 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.393342 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.393483 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.393618 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.393750 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.393882 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.394015 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.394155 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.394296 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.394438 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.394573 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.394714 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.394855 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.394988 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.395134 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.395275 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.395408 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.395540 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.395701 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.395844 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.395989 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.396124 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.396262 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.396396 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.396528 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.396670 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.396810 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.397029 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.397437 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.397578 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.397795 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.397795 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.398071 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.398216 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.398357 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.398511 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.398723 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.398875 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.399022 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.399163 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.399453 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.399658 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.399809 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.399953 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.400097 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.400229 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.400361 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.400502 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.400645 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.400780 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.400922 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.401055 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.401195 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.401330 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.401472 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.401606 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.401738 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.402379 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.402518 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.402703 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.402851 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.402993 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.403133 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.403265 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.403398 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.403544 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.403705 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.403841 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.403974 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.404114 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.404247 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.404393 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.404527 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.404659 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.404799 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.404799 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.405059 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.405059 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.405323 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.405455 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.405586 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.405724 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.405865 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.406006 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.406140 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.406278 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.406418 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.406559 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.406701 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.406834 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.406966 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.407178 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.407579 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.407772 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.407993 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.407993 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.408265 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.408398 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.408530 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.408672 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.408918 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.409056 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.409197 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.409347 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.409671 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.409671 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 07:01:45.409950 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.409950 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.409950 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.409950 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.409950 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.409950 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.409950 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.409950 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.410961 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.410961 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.410961 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.410961 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.411462 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.411626 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.411940 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.412249 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.412557 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.412876 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.413195 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.413506 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.413812 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.414118 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.414430 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.414740 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.415047 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.415353 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.415683 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.415995 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.416301 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.416607 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.416914 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.417220 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.417696 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.418601 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.418932 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.419239 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.419547 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.419959 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.420269 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.420579 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.420926 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.421264 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.421583 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.421910 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.422224 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.422551 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.422864 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.423189 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.423512 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.423861 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.424177 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.424514 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.424832 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.425145 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.425459 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.425772 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.426083 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.426396 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.426732 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.427061 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.427368 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.427722 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.428044 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.428369 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.428689 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.429000 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.429331 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.429643 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.429955 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.430265 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.430575 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.430886 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.431202 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.431513 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.431850 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.432171 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.432487 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.432819 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.433187 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.433563 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.433891 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.434221 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.434577 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.434901 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.435250 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.435580 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.435921 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.436233 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.436546 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 09 07:01:45.436792 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117858) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 09 07:01:45.561990 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO dbcounter [None req-01fb7600-f398-4783-8806-1d3aeebfa001 None None] Registered counter for database nova_api Aug 09 07:01:45.582359 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_db.sqlalchemy.engines [None req-01fb7600-f398-4783-8806-1d3aeebfa001 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117859) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 07:01:45.588640 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO dbcounter [None req-ccbfb9f2-3f4d-47eb-bc24-dafdd0c10b63 None None] Registered counter for database nova_api Aug 09 07:01:45.589037 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writer thread running {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 07:01:45.608678 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_db.sqlalchemy.engines [None req-ccbfb9f2-3f4d-47eb-bc24-dafdd0c10b63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117858) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 07:01:45.615308 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writer thread running {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 07:01:45.646566 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.context [None req-01fb7600-f398-4783-8806-1d3aeebfa001 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),82160e21-03c7-4992-b3b2-4a6a6de7b596(cell1) {{(pid=117859) load_cells /opt/stack/nova/nova/context.py:464}} Aug 09 07:01:45.650608 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-01fb7600-f398-4783-8806-1d3aeebfa001 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:01:45.651082 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-01fb7600-f398-4783-8806-1d3aeebfa001 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:01:45.652895 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-01fb7600-f398-4783-8806-1d3aeebfa001 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:01:45.653620 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-01fb7600-f398-4783-8806-1d3aeebfa001 None None] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:01:45.654067 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-01fb7600-f398-4783-8806-1d3aeebfa001 None None] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:01:45.656085 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-01fb7600-f398-4783-8806-1d3aeebfa001 None None] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:01:45.658102 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO dbcounter [None req-01fb7600-f398-4783-8806-1d3aeebfa001 None None] Registered counter for database nova_cell0 Aug 09 07:01:45.662234 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO dbcounter [None req-01fb7600-f398-4783-8806-1d3aeebfa001 None None] Registered counter for database nova_cell1 Aug 09 07:01:45.670279 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_db.sqlalchemy.engines [None req-01fb7600-f398-4783-8806-1d3aeebfa001 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117859) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 07:01:45.671515 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.context [None req-ccbfb9f2-3f4d-47eb-bc24-dafdd0c10b63 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),82160e21-03c7-4992-b3b2-4a6a6de7b596(cell1) {{(pid=117858) load_cells /opt/stack/nova/nova/context.py:464}} Aug 09 07:01:45.672740 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_db.sqlalchemy.engines [None req-01fb7600-f398-4783-8806-1d3aeebfa001 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117859) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 07:01:45.675635 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ccbfb9f2-3f4d-47eb-bc24-dafdd0c10b63 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:01:45.676108 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ccbfb9f2-3f4d-47eb-bc24-dafdd0c10b63 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:01:45.677672 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ccbfb9f2-3f4d-47eb-bc24-dafdd0c10b63 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:01:45.678406 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ccbfb9f2-3f4d-47eb-bc24-dafdd0c10b63 None None] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:01:45.678516 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writer thread running {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 07:01:45.678855 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ccbfb9f2-3f4d-47eb-bc24-dafdd0c10b63 None None] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:01:45.680879 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ccbfb9f2-3f4d-47eb-bc24-dafdd0c10b63 None None] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:01:45.682916 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO dbcounter [None req-ccbfb9f2-3f4d-47eb-bc24-dafdd0c10b63 None None] Registered counter for database nova_cell0 Aug 09 07:01:45.683993 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writer thread running {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 07:01:45.687626 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO dbcounter [None req-ccbfb9f2-3f4d-47eb-bc24-dafdd0c10b63 None None] Registered counter for database nova_cell1 Aug 09 07:01:45.694905 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_db.sqlalchemy.engines [None req-ccbfb9f2-3f4d-47eb-bc24-dafdd0c10b63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117858) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 07:01:45.697154 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_db.sqlalchemy.engines [None req-ccbfb9f2-3f4d-47eb-bc24-dafdd0c10b63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117858) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 07:01:45.701967 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writer thread running {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 07:01:45.827101 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO dbcounter [None req-01fb7600-f398-4783-8806-1d3aeebfa001 None None] Registered counter for database nova_cell0 Aug 09 07:01:45.833852 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_db.sqlalchemy.engines [None req-01fb7600-f398-4783-8806-1d3aeebfa001 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117859) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 07:01:45.840826 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writer thread running {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 07:01:45.847094 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writer thread running {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 07:01:45.858593 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO dbcounter [None req-ccbfb9f2-3f4d-47eb-bc24-dafdd0c10b63 None None] Registered counter for database nova_cell0 Aug 09 07:01:45.865476 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_db.sqlalchemy.engines [None req-ccbfb9f2-3f4d-47eb-bc24-dafdd0c10b63 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117858) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 09 07:01:45.870513 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writer thread running {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 09 07:01:46.159963 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: WARNING keystonemiddleware.auth_token [None req-01fb7600-f398-4783-8806-1d3aeebfa001 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 07:01:46.167198 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: WARNING keystonemiddleware.auth_token [None req-01fb7600-f398-4783-8806-1d3aeebfa001 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 07:01:46.193397 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: WARNING keystonemiddleware.auth_token [None req-ccbfb9f2-3f4d-47eb-bc24-dafdd0c10b63 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 07:01:46.200843 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: WARNING keystonemiddleware.auth_token [None req-ccbfb9f2-3f4d-47eb-bc24-dafdd0c10b63 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 07:01:46.508381 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: WARNING keystonemiddleware.auth_token [None req-01fb7600-f398-4783-8806-1d3aeebfa001 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 07:01:46.514413 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: WARNING keystonemiddleware.auth_token [None req-01fb7600-f398-4783-8806-1d3aeebfa001 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 07:01:46.520650 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a61eb039c0 pid: 117859 (default app) Aug 09 07:01:46.563271 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: WARNING keystonemiddleware.auth_token [None req-ccbfb9f2-3f4d-47eb-bc24-dafdd0c10b63 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 09 07:01:46.569311 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: WARNING keystonemiddleware.auth_token [None req-ccbfb9f2-3f4d-47eb-bc24-dafdd0c10b63 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 09 07:01:46.575648 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a61eb039c0 pid: 117858 (default app) Aug 09 07:02:22.027645 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=3 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:02:22.029266 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=3 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:02:22.030655 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=3 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:02:22.032416 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=3 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:02:23.281233 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-652eda0f-1de6-408e-a772-fe89a46d6031 tempest-VolumesSnapshotsTestJSON-1389857866 tempest-VolumesSnapshotsTestJSON-1389857866-project] Action: 'create', calling method: .version_select at 0x7f20dfca7e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1497593421"}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:02:23.574357 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_api:SELECT=3 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:02:23.576776 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_cell0:SELECT=3 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:02:23.578688 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_cell1:SELECT=3 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:02:23.580968 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_cell0:SELECT=3 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:02:24.067071 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-3af87b83-60cb-4cdb-8a65-76e6077aec1c tempest-VolumesTestJSON-768669208 tempest-VolumesTestJSON-768669208-project] Calling method '.version_select at 0x7f20dfc68a60>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:02:24.553197 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-3af87b83-60cb-4cdb-8a65-76e6077aec1c tempest-VolumesTestJSON-768669208 tempest-VolumesTestJSON-768669208-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/9b508267-2e0b-4734-94db-e4cefc2d7767" status: 200 len: 351 microversion: 2.1 time: 0.987392 Aug 09 07:02:24.554226 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 1/1] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Aug 9 07:02:23 2022] GET /compute/v2.1/os-volumes/9b508267-2e0b-4734-94db-e4cefc2d7767 => generated 351 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:02:24.738556 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-652eda0f-1de6-408e-a772-fe89a46d6031 tempest-VolumesSnapshotsTestJSON-1389857866 tempest-VolumesSnapshotsTestJSON-1389857866-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.737261 Aug 09 07:02:24.740076 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 1/2] 10.222.0.30 () {60 vars in 1155 bytes} [Tue Aug 9 07:02:21 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 2740 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 09 07:02:24.756467 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-2f7cafe9-e282-4632-9715-718aa196457b tempest-VolumesSnapshotsTestJSON-1389857866 tempest-VolumesSnapshotsTestJSON-1389857866-project] Calling method '.version_select at 0x7f20dfaaec10>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:02:25.107034 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-2f7cafe9-e282-4632-9715-718aa196457b tempest-VolumesSnapshotsTestJSON-1389857866 tempest-VolumesSnapshotsTestJSON-1389857866-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/6949567e-633f-4d39-bb5e-c850141f8cc3" status: 200 len: 346 microversion: 2.1 time: 0.355343 Aug 09 07:02:25.108202 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 2/3] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Aug 9 07:02:24 2022] GET /compute/v2.1/os-volumes/6949567e-633f-4d39-bb5e-c850141f8cc3 => generated 346 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:02:25.121536 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-9c713379-cba7-4751-bf60-84e7e3040e30 tempest-VolumesSnapshotsTestJSON-1389857866 tempest-VolumesSnapshotsTestJSON-1389857866-project] Action: 'create', calling method: .version_select at 0x7f20dfa74c10>, body: {"snapshot": {"volume_id": "6949567e-633f-4d39-bb5e-c850141f8cc3", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1520928394"}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:02:25.623046 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-9c713379-cba7-4751-bf60-84e7e3040e30 tempest-VolumesSnapshotsTestJSON-1389857866 tempest-VolumesSnapshotsTestJSON-1389857866-project] 10.222.0.30 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.506518 Aug 09 07:02:25.623925 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 2/4] 10.222.0.30 () {60 vars in 1162 bytes} [Tue Aug 9 07:02:25 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:02:25.634551 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-9015d229-dd44-48cb-9035-3ce33c7504b6 tempest-VolumesSnapshotsTestJSON-1389857866 tempest-VolumesSnapshotsTestJSON-1389857866-project] Calling method '.version_select at 0x7f20dfa723a0>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:02:25.707483 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-9015d229-dd44-48cb-9035-3ce33c7504b6 tempest-VolumesSnapshotsTestJSON-1389857866 tempest-VolumesSnapshotsTestJSON-1389857866-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/15562085-a476-420d-95e2-c66dd5dc19bc" status: 200 len: 287 microversion: 2.1 time: 0.076715 Aug 09 07:02:25.708069 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 3/5] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Aug 9 07:02:25 2022] GET /compute/v2.1/os-snapshots/15562085-a476-420d-95e2-c66dd5dc19bc => generated 287 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:02:25.719232 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-97f013d9-62e7-43d0-91ed-2eef3a5d3441 tempest-VolumesSnapshotsTestJSON-1389857866 tempest-VolumesSnapshotsTestJSON-1389857866-project] Calling method '.version_select at 0x7f20dfa89dc0>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:02:26.020037 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-97f013d9-62e7-43d0-91ed-2eef3a5d3441 tempest-VolumesSnapshotsTestJSON-1389857866 tempest-VolumesSnapshotsTestJSON-1389857866-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.304911 Aug 09 07:02:26.021573 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 3/6] 10.222.0.30 () {58 vars in 1140 bytes} [Tue Aug 9 07:02:25 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:02:26.033291 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-a94bf036-4032-4b0d-a652-d56ff16d9103 tempest-VolumesSnapshotsTestJSON-1389857866 tempest-VolumesSnapshotsTestJSON-1389857866-project] Calling method '.version_select at 0x7f20dfaaedc0>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:02:26.093534 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-a94bf036-4032-4b0d-a652-d56ff16d9103 tempest-VolumesSnapshotsTestJSON-1389857866 tempest-VolumesSnapshotsTestJSON-1389857866-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/15562085-a476-420d-95e2-c66dd5dc19bc" status: 200 len: 287 microversion: 2.1 time: 0.064449 Aug 09 07:02:26.094783 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 4/7] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Aug 9 07:02:26 2022] GET /compute/v2.1/os-snapshots/15562085-a476-420d-95e2-c66dd5dc19bc => generated 287 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:02:26.301884 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-78ec0f5f-a3dd-4d7a-9cbf-a5fb6ceb7003 tempest-VolumesTestJSON-768669208 tempest-VolumesTestJSON-768669208-project] Calling method '.version_select at 0x7f20dfa89af0>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:02:26.428494 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-78ec0f5f-a3dd-4d7a-9cbf-a5fb6ceb7003 tempest-VolumesTestJSON-768669208 tempest-VolumesTestJSON-768669208-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/aecea4a3-37ea-4126-b98c-932cef6ff3dd" status: 200 len: 350 microversion: 2.1 time: 0.130522 Aug 09 07:02:26.437386 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 4/8] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Aug 9 07:02:26 2022] GET /compute/v2.1/os-volumes/aecea4a3-37ea-4126-b98c-932cef6ff3dd => generated 350 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:02:27.107281 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-1d834504-dc6c-4a3e-949b-fa2be1bfc2b6 tempest-VolumesSnapshotsTestJSON-1389857866 tempest-VolumesSnapshotsTestJSON-1389857866-project] Calling method '.version_select at 0x7f20dfa72670>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:02:27.230660 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-1d834504-dc6c-4a3e-949b-fa2be1bfc2b6 tempest-VolumesSnapshotsTestJSON-1389857866 tempest-VolumesSnapshotsTestJSON-1389857866-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/15562085-a476-420d-95e2-c66dd5dc19bc" status: 200 len: 287 microversion: 2.1 time: 0.127748 Aug 09 07:02:27.236230 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 5/9] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Aug 9 07:02:27 2022] GET /compute/v2.1/os-snapshots/15562085-a476-420d-95e2-c66dd5dc19bc => generated 287 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:02:28.246853 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-43738a82-eeba-4373-a525-bd63d507ace2 tempest-VolumesSnapshotsTestJSON-1389857866 tempest-VolumesSnapshotsTestJSON-1389857866-project] Calling method '.version_select at 0x7f20dfa89550>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:02:28.286093 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-43738a82-eeba-4373-a525-bd63d507ace2 tempest-VolumesSnapshotsTestJSON-1389857866 tempest-VolumesSnapshotsTestJSON-1389857866-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/15562085-a476-420d-95e2-c66dd5dc19bc" status: 200 len: 287 microversion: 2.1 time: 0.046074 Aug 09 07:02:28.293773 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 5/10] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Aug 9 07:02:28 2022] GET /compute/v2.1/os-snapshots/15562085-a476-420d-95e2-c66dd5dc19bc => generated 287 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:02:29.309092 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-583a16d8-a8ec-4f8d-80cc-dacb893f2ff5 tempest-VolumesSnapshotsTestJSON-1389857866 tempest-VolumesSnapshotsTestJSON-1389857866-project] Calling method '.version_select at 0x7f20dfa72a60>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:02:29.379675 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-583a16d8-a8ec-4f8d-80cc-dacb893f2ff5 tempest-VolumesSnapshotsTestJSON-1389857866 tempest-VolumesSnapshotsTestJSON-1389857866-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/15562085-a476-420d-95e2-c66dd5dc19bc" status: 200 len: 288 microversion: 2.1 time: 0.083021 Aug 09 07:02:29.393811 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 6/11] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Aug 9 07:02:29 2022] GET /compute/v2.1/os-snapshots/15562085-a476-420d-95e2-c66dd5dc19bc => generated 288 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:02:29.397455 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-5dfbc25a-ba78-4082-a805-0b04d0285fcd tempest-VolumesSnapshotsTestJSON-1389857866 tempest-VolumesSnapshotsTestJSON-1389857866-project] Calling method '.version_select at 0x7f20dfa74d30>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:02:29.511671 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-5dfbc25a-ba78-4082-a805-0b04d0285fcd tempest-VolumesSnapshotsTestJSON-1389857866 tempest-VolumesSnapshotsTestJSON-1389857866-project] 10.222.0.30 "DELETE /compute/v2.1/os-snapshots/15562085-a476-420d-95e2-c66dd5dc19bc" status: 202 len: 0 microversion: 2.1 time: 0.121314 Aug 09 07:02:29.518139 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 6/12] 10.222.0.30 () {58 vars in 1254 bytes} [Tue Aug 9 07:02:29 2022] DELETE /compute/v2.1/os-snapshots/15562085-a476-420d-95e2-c66dd5dc19bc => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 07:02:29.521568 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-d84e3c79-7ff3-4a64-b38b-b8325232566e tempest-VolumesSnapshotsTestJSON-1389857866 tempest-VolumesSnapshotsTestJSON-1389857866-project] Calling method '.version_select at 0x7f20dfa7e160>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:02:29.575758 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-d84e3c79-7ff3-4a64-b38b-b8325232566e tempest-VolumesSnapshotsTestJSON-1389857866 tempest-VolumesSnapshotsTestJSON-1389857866-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/15562085-a476-420d-95e2-c66dd5dc19bc" status: 200 len: 287 microversion: 2.1 time: 0.057921 Aug 09 07:02:29.580850 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 7/13] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Aug 9 07:02:29 2022] GET /compute/v2.1/os-snapshots/15562085-a476-420d-95e2-c66dd5dc19bc => generated 287 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:02:30.333000 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-54a47192-eb1b-4660-828e-2401f840577b tempest-VolumesTestJSON-768669208 tempest-VolumesTestJSON-768669208-project] Calling method '.version_select at 0x7f20dfa74c10>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:02:30.455361 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-54a47192-eb1b-4660-828e-2401f840577b tempest-VolumesTestJSON-768669208 tempest-VolumesTestJSON-768669208-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/e03e3b73-7442-4008-80da-3a3280007799" status: 200 len: 350 microversion: 2.1 time: 0.126113 Aug 09 07:02:30.461152 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 7/14] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Aug 9 07:02:30 2022] GET /compute/v2.1/os-volumes/e03e3b73-7442-4008-80da-3a3280007799 => generated 350 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:02:30.474393 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2c1be1f7-7952-4be6-94e5-c5f6eb2030b0 tempest-VolumesTestJSON-768669208 tempest-VolumesTestJSON-768669208-project] Calling method '.version_select at 0x7f20dfa89550>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:02:30.568525 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-ed610a3f-6d90-41f2-8147-af32cac03c28 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Action: 'create', calling method: .version_select at 0x7f20dfa72d30>, body: {"keypair": {"name": "tempest-keypair-1359303097", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7flVMULlAUK8bCcNiGA6tCjMtWikl6lhi7CwaHKUHehcT5emlU09S2MXLlgABMt2iWzE06QajwIGFDUwJlr2Ew1Z6wuE56xaJ4ly8bwKHe87Wg79487+o044RqdVMO9g=="}} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:02:30.744176 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-2c1be1f7-7952-4be6-94e5-c5f6eb2030b0 tempest-VolumesTestJSON-768669208 tempest-VolumesTestJSON-768669208-project] 10.222.0.30 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.273803 Aug 09 07:02:30.754093 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 8/15] 10.222.0.30 () {58 vars in 1134 bytes} [Tue Aug 9 07:02:30 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:02:30.754093 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f233ef8d-ac36-4c54-8c3f-88911ad4bcd1 tempest-VolumesSnapshotsTestJSON-1389857866 tempest-VolumesSnapshotsTestJSON-1389857866-project] Calling method '.version_select at 0x7f20dfa8d4c0>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:02:30.781505 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.quota [None req-ed610a3f-6d90-41f2-8147-af32cac03c28 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Getting quotas for project f38c6aa37b9643bbbe5bb7fd3efde4fd. Resources: {'key_pairs'} {{(pid=117858) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 07:02:30.816505 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.quota [None req-ed610a3f-6d90-41f2-8147-af32cac03c28 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Getting quotas for user cc885026afe041cca086367bb67d8a9b and project f38c6aa37b9643bbbe5bb7fd3efde4fd. Resources: {'key_pairs'} {{(pid=117858) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 07:02:30.824260 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f233ef8d-ac36-4c54-8c3f-88911ad4bcd1 tempest-VolumesSnapshotsTestJSON-1389857866 tempest-VolumesSnapshotsTestJSON-1389857866-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/15562085-a476-420d-95e2-c66dd5dc19bc" status: 200 len: 287 microversion: 2.1 time: 0.077206 Aug 09 07:02:30.825019 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 9/16] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Aug 9 07:02:30 2022] GET /compute/v2.1/os-snapshots/15562085-a476-420d-95e2-c66dd5dc19bc => generated 287 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:02:30.863015 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-1bf53903-580b-48d5-8db2-942befa6776c tempest-VolumesTestJSON-768669208 tempest-VolumesTestJSON-768669208-project] Calling method '.version_select at 0x7f20dfa89f70>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:02:31.014159 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-ed610a3f-6d90-41f2-8147-af32cac03c28 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.618773 Aug 09 07:02:31.036239 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 8/17] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 9 07:02:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:02:31.083043 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-1bf53903-580b-48d5-8db2-942befa6776c tempest-VolumesTestJSON-768669208 tempest-VolumesTestJSON-768669208-project] 10.222.0.30 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.256775 Aug 09 07:02:31.083946 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 10/18] 10.222.0.30 () {58 vars in 1149 bytes} [Tue Aug 9 07:02:30 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:02:31.099151 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-51ba3de5-6d59-43b7-9f87-55ca95075962 tempest-VolumesTestJSON-768669208 tempest-VolumesTestJSON-768669208-project] Calling method '.version_select at 0x7f20dfa5ea60>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:02:31.298186 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-51ba3de5-6d59-43b7-9f87-55ca95075962 tempest-VolumesTestJSON-768669208 tempest-VolumesTestJSON-768669208-project] 10.222.0.30 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.203855 Aug 09 07:02:31.300389 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 9/19] 10.222.0.30 () {58 vars in 1134 bytes} [Tue Aug 9 07:02:31 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:02:31.313451 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-657ddeb4-d7b4-4b53-9b5d-f998f2ff5acc tempest-VolumesTestJSON-768669208 tempest-VolumesTestJSON-768669208-project] Calling method '.version_select at 0x7f20dfa8d0d0>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:02:31.522061 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-657ddeb4-d7b4-4b53-9b5d-f998f2ff5acc tempest-VolumesTestJSON-768669208 tempest-VolumesTestJSON-768669208-project] 10.222.0.30 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.212619 Aug 09 07:02:31.522620 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 11/20] 10.222.0.30 () {58 vars in 1167 bytes} [Tue Aug 9 07:02:31 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:02:31.536661 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-e2577829-e92f-4b06-be40-8fd9ad75b656 tempest-VolumesTestJSON-768669208 tempest-VolumesTestJSON-768669208-project] Calling method '.version_select at 0x7f20df2171f0>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:02:31.731576 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-e2577829-e92f-4b06-be40-8fd9ad75b656 tempest-VolumesTestJSON-768669208 tempest-VolumesTestJSON-768669208-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.198573 Aug 09 07:02:31.732423 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 10/21] 10.222.0.30 () {58 vars in 1170 bytes} [Tue Aug 9 07:02:31 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:02:31.746098 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-24939f06-f992-43f2-b6a4-2e0881c9fc3e tempest-VolumesTestJSON-768669208 tempest-VolumesTestJSON-768669208-project] Calling method '.version_select at 0x7f20dfaa03a0>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:02:31.837599 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-38b5b802-b789-4dec-a668-1bf20fe0b568 tempest-VolumesSnapshotsTestJSON-1389857866 tempest-VolumesSnapshotsTestJSON-1389857866-project] Calling method '.version_select at 0x7f20df20f4c0>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:02:31.912827 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-38b5b802-b789-4dec-a668-1bf20fe0b568 tempest-VolumesSnapshotsTestJSON-1389857866 tempest-VolumesSnapshotsTestJSON-1389857866-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/15562085-a476-420d-95e2-c66dd5dc19bc" status: 200 len: 287 microversion: 2.1 time: 0.079327 Aug 09 07:02:31.913403 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 11/22] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Aug 9 07:02:31 2022] GET /compute/v2.1/os-snapshots/15562085-a476-420d-95e2-c66dd5dc19bc => generated 287 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 07:02:31.992982 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-24939f06-f992-43f2-b6a4-2e0881c9fc3e tempest-VolumesTestJSON-768669208 tempest-VolumesTestJSON-768669208-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.251508 Aug 09 07:02:32.003417 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 12/23] 10.222.0.30 () {58 vars in 1155 bytes} [Tue Aug 9 07:02:31 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:02:32.008774 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-55ec4b21-4277-4285-9a9c-d71eb966ebd4 tempest-VolumesTestJSON-768669208 tempest-VolumesTestJSON-768669208-project] Calling method '.version_select at 0x7f20dfa5ef70>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:02:32.194387 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-55ec4b21-4277-4285-9a9c-d71eb966ebd4 tempest-VolumesTestJSON-768669208 tempest-VolumesTestJSON-768669208-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.190070 Aug 09 07:02:32.195290 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 12/24] 10.222.0.30 () {58 vars in 1188 bytes} [Tue Aug 9 07:02:32 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:02:32.211208 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2827f9d7-fda4-4471-8d48-ed674d856b6b tempest-VolumesTestJSON-768669208 tempest-VolumesTestJSON-768669208-project] Calling method '.version_select at 0x7f20dfa8d430>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:02:32.372625 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-2827f9d7-fda4-4471-8d48-ed674d856b6b tempest-VolumesTestJSON-768669208 tempest-VolumesTestJSON-768669208-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.165539 Aug 09 07:02:32.373268 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 13/25] 10.222.0.30 () {58 vars in 1155 bytes} [Tue Aug 9 07:02:32 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:02:32.927402 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-4ea61b09-6deb-443f-8aaa-ef9bad70c420 tempest-VolumesSnapshotsTestJSON-1389857866 tempest-VolumesSnapshotsTestJSON-1389857866-project] Calling method '.version_select at 0x7f20df21c5e0>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:02:32.990299 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.wsgi [None req-4ea61b09-6deb-443f-8aaa-ef9bad70c420 tempest-VolumesSnapshotsTestJSON-1389857866 tempest-VolumesSnapshotsTestJSON-1389857866-project] HTTP exception thrown: Snapshot 15562085-a476-420d-95e2-c66dd5dc19bc could not be found. Aug 09 07:02:32.996113 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-4ea61b09-6deb-443f-8aaa-ef9bad70c420 tempest-VolumesSnapshotsTestJSON-1389857866 tempest-VolumesSnapshotsTestJSON-1389857866-project] Request method failure captured: Aug 09 07:02:32.996113 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: request: GET /compute/v2.1/os-snapshots/15562085-a476-420d-95e2-c66dd5dc19bc HTTP/1.1 Aug 09 07:02:32.996113 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Accept: application/json Aug 09 07:02:32.996113 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Accept-Encoding: identity Aug 09 07:02:32.996113 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Connection: close Aug 09 07:02:32.996113 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Content-Length: 0 Aug 09 07:02:32.996113 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Content-Type: application/json Aug 09 07:02:32.996113 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Host: 10.222.0.30 Aug 09 07:02:32.996113 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Openstack-System-Scope: None Aug 09 07:02:32.996113 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: User-Agent: python-urllib3/1.26.11 Aug 09 07:02:32.996113 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Auth-Token: gAAAAABi8gZ9ZmW_SQCVz3MvhAfuuXPM_xMZc29nBSg3TdYzTiqEqaE6nAkzGSpaXdY8FdxXRuFXAfzPhd-KY9coMVw8hWeSWBGO2IxKFZWIvTqzESUNjccWBLwb8L4qsZ8m-WrOGzYt9Z8VAgjl0Wcb62Kpn0Lgnvx1-PvCLwXuDVTDlD2lI78 Aug 09 07:02:32.996113 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Domain-Id: None Aug 09 07:02:32.996113 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Domain-Name: None Aug 09 07:02:32.996113 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Identity-Status: Confirmed Aug 09 07:02:32.996113 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Is-Admin-Project: True Aug 09 07:02:32.996113 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Domain-Id: default Aug 09 07:02:32.996113 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Domain-Name: Default Aug 09 07:02:32.996113 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Id: a20ca03aff6048049ace8e8bcafb6ee1 Aug 09 07:02:32.996113 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1389857866 Aug 09 07:02:32.996113 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Role: reader,member Aug 09 07:02:32.996113 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Roles: reader,member Aug 09 07:02:32.997416 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a20ca03aff6048049ace8e8bcafb6ee1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a20ca03aff6048049ace8e8bcafb6ee1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a20ca03aff6048049ace8e8bcafb6ee1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a20ca03aff6048049ace8e8bcafb6ee1"}]}] Aug 09 07:02:32.997416 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1389857866 Aug 09 07:02:32.997416 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant-Id: a20ca03aff6048049ace8e8bcafb6ee1 Aug 09 07:02:32.997416 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1389857866 Aug 09 07:02:32.997416 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User: tempest-VolumesSnapshotsTestJSON-1389857866-project Aug 09 07:02:32.997416 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Domain-Id: default Aug 09 07:02:32.997416 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Domain-Name: Default Aug 09 07:02:32.997416 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Id: 4fa7298e183f45e48e02419abecda282 Aug 09 07:02:32.997416 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1389857866-project Aug 09 07:02:32.997416 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: method: Aug 09 07:02:32.997416 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: exception: Snapshot 15562085-a476-420d-95e2-c66dd5dc19bc could not be found. Aug 09 07:02:32.997416 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: action_args: {'id': '15562085-a476-420d-95e2-c66dd5dc19bc'} Aug 09 07:02:32.997416 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 07:02:32.998142 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:02:32.998142 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 09 07:02:32.998142 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 09 07:02:32.998142 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 09 07:02:32.998142 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 09 07:02:32.998142 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 09 07:02:32.998142 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 09 07:02:32.998142 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 07:02:32.998142 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 07:02:32.998142 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 07:02:32.998142 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 07:02:32.998142 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 07:02:32.998142 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 07:02:32.998142 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 07:02:32.998142 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 07:02:32.998142 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 15562085-a476-420d-95e2-c66dd5dc19bc could not be found. (HTTP 404) (Request-ID: req-c6588bc9-d0f0-40c5-b45d-eb5c48074cb9) Aug 09 07:02:32.998142 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:02:32.998142 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:02:32.999091 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:02:32.999091 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:02:32.999091 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 09 07:02:32.999091 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 09 07:02:32.999091 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 07:02:32.999091 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 07:02:32.999091 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 09 07:02:32.999091 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 09 07:02:32.999091 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 07:02:32.999091 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 07:02:32.999091 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 09 07:02:32.999091 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 09 07:02:32.999091 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 09 07:02:32.999091 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 09 07:02:32.999091 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 09 07:02:32.999091 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 09 07:02:32.999091 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 07:02:32.999091 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 07:02:32.999091 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 07:02:33.000158 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 07:02:33.000158 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 07:02:33.000158 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 07:02:33.000158 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 07:02:33.000158 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 07:02:33.000158 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 15562085-a476-420d-95e2-c66dd5dc19bc could not be found. Aug 09 07:02:33.000158 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:02:33.000158 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:02:33.000158 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:02:33.000158 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:02:33.000158 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:02:33.000158 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:02:33.000158 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 07:02:33.000158 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 07:02:33.000158 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 07:02:33.000158 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 07:02:33.000158 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 07:02:33.000158 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 07:02:33.000158 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 09 07:02:33.000158 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 07:02:33.001377 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 15562085-a476-420d-95e2-c66dd5dc19bc could not be found. Aug 09 07:02:33.001377 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:02:33.001377 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:02:33.001377 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:02:33.001377 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:02:33.001377 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:02:33.001377 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:02:33.001377 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 07:02:33.001377 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 07:02:33.001377 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 15562085-a476-420d-95e2-c66dd5dc19bc could not be found. Aug 09 07:02:33.001377 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:02:33.001377 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-4ea61b09-6deb-443f-8aaa-ef9bad70c420 tempest-VolumesSnapshotsTestJSON-1389857866 tempest-VolumesSnapshotsTestJSON-1389857866-project] Returning 404 to user: Snapshot 15562085-a476-420d-95e2-c66dd5dc19bc could not be found. {{(pid=117858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 07:02:33.001377 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-4ea61b09-6deb-443f-8aaa-ef9bad70c420 tempest-VolumesSnapshotsTestJSON-1389857866 tempest-VolumesSnapshotsTestJSON-1389857866-project] 10.222.0.30 "GET /compute/v2.1/os-snapshots/15562085-a476-420d-95e2-c66dd5dc19bc" status: 404 len: 111 microversion: 2.1 time: 0.075551 Aug 09 07:02:33.002020 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 13/26] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Aug 9 07:02:32 2022] GET /compute/v2.1/os-snapshots/15562085-a476-420d-95e2-c66dd5dc19bc => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 07:02:33.008780 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6dc6bf86-1238-4af6-9992-f32bb7d04a3c tempest-VolumesSnapshotsTestJSON-1389857866 tempest-VolumesSnapshotsTestJSON-1389857866-project] Calling method '.version_select at 0x7f20dfa89a60>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:02:33.152314 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-6dc6bf86-1238-4af6-9992-f32bb7d04a3c tempest-VolumesSnapshotsTestJSON-1389857866 tempest-VolumesSnapshotsTestJSON-1389857866-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/6949567e-633f-4d39-bb5e-c850141f8cc3" status: 202 len: 0 microversion: 2.1 time: 0.147964 Aug 09 07:02:33.153233 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 14/27] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Aug 9 07:02:33 2022] DELETE /compute/v2.1/os-volumes/6949567e-633f-4d39-bb5e-c850141f8cc3 => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 07:02:33.164795 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-95204c90-b740-430b-8bb6-84275f3fd6ba tempest-VolumesSnapshotsTestJSON-1389857866 tempest-VolumesSnapshotsTestJSON-1389857866-project] Calling method '.version_select at 0x7f20df21c8b0>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:02:33.316775 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-95204c90-b740-430b-8bb6-84275f3fd6ba tempest-VolumesSnapshotsTestJSON-1389857866 tempest-VolumesSnapshotsTestJSON-1389857866-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/6949567e-633f-4d39-bb5e-c850141f8cc3" status: 200 len: 345 microversion: 2.1 time: 0.158333 Aug 09 07:02:33.318080 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 14/28] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Aug 9 07:02:33 2022] GET /compute/v2.1/os-volumes/6949567e-633f-4d39-bb5e-c850141f8cc3 => generated 345 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:02:34.332474 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c98cbe5e-969b-47b8-8efd-e295f0564c78 tempest-VolumesSnapshotsTestJSON-1389857866 tempest-VolumesSnapshotsTestJSON-1389857866-project] Calling method '.version_select at 0x7f20dfaa05e0>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:02:34.398758 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-c98cbe5e-969b-47b8-8efd-e295f0564c78 tempest-VolumesSnapshotsTestJSON-1389857866 tempest-VolumesSnapshotsTestJSON-1389857866-project] HTTP exception thrown: Volume 6949567e-633f-4d39-bb5e-c850141f8cc3 could not be found. Aug 09 07:02:34.403091 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c98cbe5e-969b-47b8-8efd-e295f0564c78 tempest-VolumesSnapshotsTestJSON-1389857866 tempest-VolumesSnapshotsTestJSON-1389857866-project] Request method failure captured: Aug 09 07:02:34.403091 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/os-volumes/6949567e-633f-4d39-bb5e-c850141f8cc3 HTTP/1.1 Aug 09 07:02:34.403091 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 09 07:02:34.403091 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 09 07:02:34.403091 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Connection: close Aug 09 07:02:34.403091 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Length: 0 Aug 09 07:02:34.403091 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 09 07:02:34.403091 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.30 Aug 09 07:02:34.403091 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 09 07:02:34.403091 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.11 Aug 09 07:02:34.403091 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi8gZ9ZmW_SQCVz3MvhAfuuXPM_xMZc29nBSg3TdYzTiqEqaE6nAkzGSpaXdY8FdxXRuFXAfzPhd-KY9coMVw8hWeSWBGO2IxKFZWIvTqzESUNjccWBLwb8L4qsZ8m-WrOGzYt9Z8VAgjl0Wcb62Kpn0Lgnvx1-PvCLwXuDVTDlD2lI78 Aug 09 07:02:34.403091 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 09 07:02:34.403091 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 09 07:02:34.403091 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 09 07:02:34.403091 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 09 07:02:34.403091 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 09 07:02:34.403091 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 09 07:02:34.403091 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Id: a20ca03aff6048049ace8e8bcafb6ee1 Aug 09 07:02:34.403091 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1389857866 Aug 09 07:02:34.403091 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 09 07:02:34.403091 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 09 07:02:34.404267 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a20ca03aff6048049ace8e8bcafb6ee1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a20ca03aff6048049ace8e8bcafb6ee1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a20ca03aff6048049ace8e8bcafb6ee1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a20ca03aff6048049ace8e8bcafb6ee1"}]}] Aug 09 07:02:34.404267 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1389857866 Aug 09 07:02:34.404267 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: a20ca03aff6048049ace8e8bcafb6ee1 Aug 09 07:02:34.404267 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1389857866 Aug 09 07:02:34.404267 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User: tempest-VolumesSnapshotsTestJSON-1389857866-project Aug 09 07:02:34.404267 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 09 07:02:34.404267 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 09 07:02:34.404267 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Id: 4fa7298e183f45e48e02419abecda282 Aug 09 07:02:34.404267 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1389857866-project Aug 09 07:02:34.404267 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: method: Aug 09 07:02:34.404267 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: exception: Volume 6949567e-633f-4d39-bb5e-c850141f8cc3 could not be found. Aug 09 07:02:34.404267 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: action_args: {'id': '6949567e-633f-4d39-bb5e-c850141f8cc3'} Aug 09 07:02:34.404267 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 07:02:34.404932 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:02:34.404932 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 07:02:34.404932 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 07:02:34.404932 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 07:02:34.404932 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 07:02:34.404932 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 07:02:34.404932 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 07:02:34.404932 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 07:02:34.404932 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 07:02:34.404932 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 07:02:34.404932 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 07:02:34.404932 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 07:02:34.404932 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 07:02:34.404932 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 07:02:34.404932 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 07:02:34.404932 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6949567e-633f-4d39-bb5e-c850141f8cc3 could not be found. (HTTP 404) (Request-ID: req-126481ed-7588-4e7c-ad0e-dec2257fc550) Aug 09 07:02:34.404932 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:02:34.404932 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:02:34.404932 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:02:34.405990 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:02:34.405990 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 09 07:02:34.405990 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 09 07:02:34.405990 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 07:02:34.405990 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 07:02:34.405990 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 07:02:34.405990 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 07:02:34.405990 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 07:02:34.405990 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 07:02:34.405990 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 07:02:34.405990 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 07:02:34.405990 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 07:02:34.405990 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 07:02:34.405990 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 07:02:34.405990 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 07:02:34.405990 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 07:02:34.405990 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 07:02:34.405990 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 07:02:34.405990 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 07:02:34.406968 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 07:02:34.406968 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 07:02:34.406968 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 07:02:34.406968 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 07:02:34.406968 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6949567e-633f-4d39-bb5e-c850141f8cc3 could not be found. Aug 09 07:02:34.406968 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:02:34.406968 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:02:34.406968 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:02:34.406968 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:02:34.406968 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:02:34.406968 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:02:34.406968 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 07:02:34.406968 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 07:02:34.406968 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 07:02:34.406968 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 07:02:34.406968 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 07:02:34.406968 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 07:02:34.406968 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 09 07:02:34.406968 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 07:02:34.407995 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6949567e-633f-4d39-bb5e-c850141f8cc3 could not be found. Aug 09 07:02:34.407995 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:02:34.407995 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:02:34.407995 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:02:34.407995 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:02:34.407995 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:02:34.407995 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:02:34.407995 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 07:02:34.407995 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 07:02:34.407995 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6949567e-633f-4d39-bb5e-c850141f8cc3 could not be found. Aug 09 07:02:34.407995 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:02:34.408769 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c98cbe5e-969b-47b8-8efd-e295f0564c78 tempest-VolumesSnapshotsTestJSON-1389857866 tempest-VolumesSnapshotsTestJSON-1389857866-project] Returning 404 to user: Volume 6949567e-633f-4d39-bb5e-c850141f8cc3 could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 07:02:34.409685 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c98cbe5e-969b-47b8-8efd-e295f0564c78 tempest-VolumesSnapshotsTestJSON-1389857866 tempest-VolumesSnapshotsTestJSON-1389857866-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/6949567e-633f-4d39-bb5e-c850141f8cc3" status: 404 len: 109 microversion: 2.1 time: 0.081206 Aug 09 07:02:34.410641 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 15/29] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Aug 9 07:02:34 2022] GET /compute/v2.1/os-volumes/6949567e-633f-4d39-bb5e-c850141f8cc3 => generated 109 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 07:02:34.428078 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-2d32b1ee-00c8-438b-8eb9-afb8a2552de6 tempest-VolumesSnapshotsTestJSON-1389857866 tempest-VolumesSnapshotsTestJSON-1389857866-project] Calling method '.version_select at 0x7f20e03fd040>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:02:34.511667 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.wsgi [None req-2d32b1ee-00c8-438b-8eb9-afb8a2552de6 tempest-VolumesSnapshotsTestJSON-1389857866 tempest-VolumesSnapshotsTestJSON-1389857866-project] HTTP exception thrown: Volume 6949567e-633f-4d39-bb5e-c850141f8cc3 could not be found. Aug 09 07:02:34.514876 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-2d32b1ee-00c8-438b-8eb9-afb8a2552de6 tempest-VolumesSnapshotsTestJSON-1389857866 tempest-VolumesSnapshotsTestJSON-1389857866-project] Request method failure captured: Aug 09 07:02:34.514876 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: request: DELETE /compute/v2.1/os-volumes/6949567e-633f-4d39-bb5e-c850141f8cc3 HTTP/1.1 Aug 09 07:02:34.514876 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Accept: application/json Aug 09 07:02:34.514876 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Accept-Encoding: identity Aug 09 07:02:34.514876 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Connection: close Aug 09 07:02:34.514876 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Content-Length: 0 Aug 09 07:02:34.514876 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Content-Type: application/json Aug 09 07:02:34.514876 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Host: 10.222.0.30 Aug 09 07:02:34.514876 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Openstack-System-Scope: None Aug 09 07:02:34.514876 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: User-Agent: python-urllib3/1.26.11 Aug 09 07:02:34.514876 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Auth-Token: gAAAAABi8gZ9ZmW_SQCVz3MvhAfuuXPM_xMZc29nBSg3TdYzTiqEqaE6nAkzGSpaXdY8FdxXRuFXAfzPhd-KY9coMVw8hWeSWBGO2IxKFZWIvTqzESUNjccWBLwb8L4qsZ8m-WrOGzYt9Z8VAgjl0Wcb62Kpn0Lgnvx1-PvCLwXuDVTDlD2lI78 Aug 09 07:02:34.514876 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Domain-Id: None Aug 09 07:02:34.514876 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Domain-Name: None Aug 09 07:02:34.514876 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Identity-Status: Confirmed Aug 09 07:02:34.514876 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Is-Admin-Project: True Aug 09 07:02:34.514876 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Domain-Id: default Aug 09 07:02:34.514876 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Domain-Name: Default Aug 09 07:02:34.514876 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Id: a20ca03aff6048049ace8e8bcafb6ee1 Aug 09 07:02:34.514876 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1389857866 Aug 09 07:02:34.514876 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Role: reader,member Aug 09 07:02:34.514876 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Roles: reader,member Aug 09 07:02:34.515977 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a20ca03aff6048049ace8e8bcafb6ee1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a20ca03aff6048049ace8e8bcafb6ee1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a20ca03aff6048049ace8e8bcafb6ee1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a20ca03aff6048049ace8e8bcafb6ee1"}]}] Aug 09 07:02:34.515977 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1389857866 Aug 09 07:02:34.515977 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant-Id: a20ca03aff6048049ace8e8bcafb6ee1 Aug 09 07:02:34.515977 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1389857866 Aug 09 07:02:34.515977 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User: tempest-VolumesSnapshotsTestJSON-1389857866-project Aug 09 07:02:34.515977 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Domain-Id: default Aug 09 07:02:34.515977 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Domain-Name: Default Aug 09 07:02:34.515977 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Id: 4fa7298e183f45e48e02419abecda282 Aug 09 07:02:34.515977 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1389857866-project Aug 09 07:02:34.515977 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: method: Aug 09 07:02:34.515977 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: exception: Volume 6949567e-633f-4d39-bb5e-c850141f8cc3 could not be found. Aug 09 07:02:34.515977 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: action_args: {'id': '6949567e-633f-4d39-bb5e-c850141f8cc3'} Aug 09 07:02:34.515977 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 07:02:34.516620 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:02:34.516620 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 07:02:34.516620 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 07:02:34.516620 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 07:02:34.516620 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 07:02:34.516620 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 07:02:34.516620 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 07:02:34.516620 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 07:02:34.516620 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 07:02:34.516620 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 07:02:34.516620 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 07:02:34.516620 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 07:02:34.516620 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 07:02:34.516620 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 07:02:34.516620 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 07:02:34.516620 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6949567e-633f-4d39-bb5e-c850141f8cc3 could not be found. (HTTP 404) (Request-ID: req-eb7e4f0f-965c-4d4d-aabf-c57a557998d0) Aug 09 07:02:34.516620 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:02:34.516620 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:02:34.516620 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:02:34.517560 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:02:34.517560 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 09 07:02:34.517560 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 09 07:02:34.517560 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 07:02:34.517560 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 07:02:34.517560 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 07:02:34.517560 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 07:02:34.517560 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 07:02:34.517560 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 07:02:34.517560 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 07:02:34.517560 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 07:02:34.517560 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 07:02:34.517560 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 07:02:34.517560 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 07:02:34.517560 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 07:02:34.517560 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 07:02:34.517560 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 07:02:34.517560 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 07:02:34.517560 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 07:02:34.518541 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 07:02:34.518541 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 07:02:34.518541 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 07:02:34.518541 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 07:02:34.518541 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6949567e-633f-4d39-bb5e-c850141f8cc3 could not be found. Aug 09 07:02:34.518541 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:02:34.518541 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:02:34.518541 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:02:34.518541 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:02:34.518541 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:02:34.518541 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:02:34.518541 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 07:02:34.518541 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 07:02:34.518541 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 07:02:34.518541 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 07:02:34.518541 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 07:02:34.518541 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 07:02:34.518541 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 09 07:02:34.518541 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 07:02:34.519527 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6949567e-633f-4d39-bb5e-c850141f8cc3 could not be found. Aug 09 07:02:34.519527 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:02:34.519527 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:02:34.519527 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:02:34.519527 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:02:34.519527 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:02:34.519527 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:02:34.519527 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 07:02:34.519527 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 07:02:34.519527 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6949567e-633f-4d39-bb5e-c850141f8cc3 could not be found. Aug 09 07:02:34.519527 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:02:34.521085 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-2d32b1ee-00c8-438b-8eb9-afb8a2552de6 tempest-VolumesSnapshotsTestJSON-1389857866 tempest-VolumesSnapshotsTestJSON-1389857866-project] Returning 404 to user: Volume 6949567e-633f-4d39-bb5e-c850141f8cc3 could not be found. {{(pid=117858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 07:02:34.522645 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-2d32b1ee-00c8-438b-8eb9-afb8a2552de6 tempest-VolumesSnapshotsTestJSON-1389857866 tempest-VolumesSnapshotsTestJSON-1389857866-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/6949567e-633f-4d39-bb5e-c850141f8cc3" status: 404 len: 109 microversion: 2.1 time: 0.101124 Aug 09 07:02:34.523537 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 15/30] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Aug 9 07:02:34 2022] DELETE /compute/v2.1/os-volumes/6949567e-633f-4d39-bb5e-c850141f8cc3 => generated 109 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 07:02:34.532821 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-13fe079f-edf5-412a-85be-e8fbddc5f6f5 tempest-VolumesSnapshotsTestJSON-1389857866 tempest-VolumesSnapshotsTestJSON-1389857866-project] Calling method '.version_select at 0x7f20dfa8d670>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:02:34.581427 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-13fe079f-edf5-412a-85be-e8fbddc5f6f5 tempest-VolumesSnapshotsTestJSON-1389857866 tempest-VolumesSnapshotsTestJSON-1389857866-project] HTTP exception thrown: Volume 6949567e-633f-4d39-bb5e-c850141f8cc3 could not be found. Aug 09 07:02:34.586007 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-13fe079f-edf5-412a-85be-e8fbddc5f6f5 tempest-VolumesSnapshotsTestJSON-1389857866 tempest-VolumesSnapshotsTestJSON-1389857866-project] Request method failure captured: Aug 09 07:02:34.586007 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/os-volumes/6949567e-633f-4d39-bb5e-c850141f8cc3 HTTP/1.1 Aug 09 07:02:34.586007 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 09 07:02:34.586007 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 09 07:02:34.586007 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Connection: close Aug 09 07:02:34.586007 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Length: 0 Aug 09 07:02:34.586007 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 09 07:02:34.586007 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.30 Aug 09 07:02:34.586007 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 09 07:02:34.586007 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.11 Aug 09 07:02:34.586007 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi8gZ9ZmW_SQCVz3MvhAfuuXPM_xMZc29nBSg3TdYzTiqEqaE6nAkzGSpaXdY8FdxXRuFXAfzPhd-KY9coMVw8hWeSWBGO2IxKFZWIvTqzESUNjccWBLwb8L4qsZ8m-WrOGzYt9Z8VAgjl0Wcb62Kpn0Lgnvx1-PvCLwXuDVTDlD2lI78 Aug 09 07:02:34.586007 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 09 07:02:34.586007 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 09 07:02:34.586007 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 09 07:02:34.586007 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 09 07:02:34.586007 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 09 07:02:34.586007 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 09 07:02:34.586007 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Id: a20ca03aff6048049ace8e8bcafb6ee1 Aug 09 07:02:34.586007 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1389857866 Aug 09 07:02:34.586007 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 09 07:02:34.586007 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 09 07:02:34.587032 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a20ca03aff6048049ace8e8bcafb6ee1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a20ca03aff6048049ace8e8bcafb6ee1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a20ca03aff6048049ace8e8bcafb6ee1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a20ca03aff6048049ace8e8bcafb6ee1"}]}] Aug 09 07:02:34.587032 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1389857866 Aug 09 07:02:34.587032 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: a20ca03aff6048049ace8e8bcafb6ee1 Aug 09 07:02:34.587032 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1389857866 Aug 09 07:02:34.587032 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User: tempest-VolumesSnapshotsTestJSON-1389857866-project Aug 09 07:02:34.587032 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 09 07:02:34.587032 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 09 07:02:34.587032 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Id: 4fa7298e183f45e48e02419abecda282 Aug 09 07:02:34.587032 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1389857866-project Aug 09 07:02:34.587032 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: method: Aug 09 07:02:34.587032 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: exception: Volume 6949567e-633f-4d39-bb5e-c850141f8cc3 could not be found. Aug 09 07:02:34.587032 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: action_args: {'id': '6949567e-633f-4d39-bb5e-c850141f8cc3'} Aug 09 07:02:34.587032 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 07:02:34.588355 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:02:34.588355 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 07:02:34.588355 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 07:02:34.588355 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 07:02:34.588355 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 07:02:34.588355 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 07:02:34.588355 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 07:02:34.588355 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 07:02:34.588355 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 07:02:34.588355 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 07:02:34.588355 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 07:02:34.588355 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 07:02:34.588355 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 07:02:34.588355 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 07:02:34.588355 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 07:02:34.588355 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6949567e-633f-4d39-bb5e-c850141f8cc3 could not be found. (HTTP 404) (Request-ID: req-c691a5cb-4b39-4029-b640-591e7e2fbb86) Aug 09 07:02:34.588355 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:02:34.588355 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:02:34.588355 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:02:34.590174 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:02:34.590174 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 09 07:02:34.590174 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 09 07:02:34.590174 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 07:02:34.590174 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 07:02:34.590174 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 07:02:34.590174 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 07:02:34.590174 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 07:02:34.590174 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 07:02:34.590174 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 07:02:34.590174 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 07:02:34.590174 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 07:02:34.590174 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 07:02:34.590174 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 07:02:34.590174 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 07:02:34.590174 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 07:02:34.590174 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 07:02:34.590174 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 07:02:34.590174 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 07:02:34.592777 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 07:02:34.592777 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 07:02:34.592777 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 07:02:34.592777 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 07:02:34.592777 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6949567e-633f-4d39-bb5e-c850141f8cc3 could not be found. Aug 09 07:02:34.592777 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:02:34.592777 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:02:34.592777 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:02:34.592777 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:02:34.592777 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:02:34.592777 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:02:34.592777 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 07:02:34.592777 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 07:02:34.592777 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 07:02:34.592777 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 07:02:34.592777 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 07:02:34.592777 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 07:02:34.592777 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 09 07:02:34.592777 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 07:02:34.595410 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6949567e-633f-4d39-bb5e-c850141f8cc3 could not be found. Aug 09 07:02:34.595410 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:02:34.595410 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:02:34.595410 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:02:34.595410 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:02:34.595410 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:02:34.595410 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:02:34.595410 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 07:02:34.595410 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 07:02:34.595410 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6949567e-633f-4d39-bb5e-c850141f8cc3 could not be found. Aug 09 07:02:34.595410 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:02:34.595410 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-13fe079f-edf5-412a-85be-e8fbddc5f6f5 tempest-VolumesSnapshotsTestJSON-1389857866 tempest-VolumesSnapshotsTestJSON-1389857866-project] Returning 404 to user: Volume 6949567e-633f-4d39-bb5e-c850141f8cc3 could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 07:02:34.595410 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-13fe079f-edf5-412a-85be-e8fbddc5f6f5 tempest-VolumesSnapshotsTestJSON-1389857866 tempest-VolumesSnapshotsTestJSON-1389857866-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/6949567e-633f-4d39-bb5e-c850141f8cc3" status: 404 len: 109 microversion: 2.1 time: 0.059838 Aug 09 07:02:34.595410 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 16/31] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Aug 9 07:02:34 2022] GET /compute/v2.1/os-volumes/6949567e-633f-4d39-bb5e-c850141f8cc3 => generated 109 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 07:02:37.424345 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-f6141674-b2e9-4f27-a675-3a1ee118fc49 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-590603072", "imageRef": "5d2c35cc-2f3b-4a22-bd68-79c71882b6a2", "flavorRef": "452", "networks": [{"uuid": "4550d9b5-494f-4697-86a9-31fc56faecd2"}]}} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:02:37.701182 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.network.neutron [None req-f6141674-b2e9-4f27-a675-3a1ee118fc49 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] validate_networks() for [('4550d9b5-494f-4697-86a9-31fc56faecd2', None, None, None, None, None)] {{(pid=117858) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 07:02:39.689054 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.virt.hardware [None req-f6141674-b2e9-4f27-a675-3a1ee118fc49 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Flavor limits 0:0:0 {{(pid=117858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 07:02:39.690696 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.virt.hardware [None req-f6141674-b2e9-4f27-a675-3a1ee118fc49 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Image limits 0:0:0 {{(pid=117858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 07:02:39.692174 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.virt.hardware [None req-f6141674-b2e9-4f27-a675-3a1ee118fc49 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Flavor pref 0:0:0 {{(pid=117858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 07:02:39.693115 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.virt.hardware [None req-f6141674-b2e9-4f27-a675-3a1ee118fc49 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Image pref 0:0:0 {{(pid=117858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 07:02:39.693798 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.virt.hardware [None req-f6141674-b2e9-4f27-a675-3a1ee118fc49 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 07:02:39.725518 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f6141674-b2e9-4f27-a675-3a1ee118fc49 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:02:39.726528 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f6141674-b2e9-4f27-a675-3a1ee118fc49 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:02:39.727116 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f6141674-b2e9-4f27-a675-3a1ee118fc49 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:02:39.731749 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f6141674-b2e9-4f27-a675-3a1ee118fc49 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:02:39.732558 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f6141674-b2e9-4f27-a675-3a1ee118fc49 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:02:39.735377 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f6141674-b2e9-4f27-a675-3a1ee118fc49 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:02:39.784269 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.quota [None req-f6141674-b2e9-4f27-a675-3a1ee118fc49 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Getting quotas for project a1b8f338b40e4d7e9a6249084bcdaa73. Resources: {'cores', 'instances', 'ram'} {{(pid=117858) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 07:02:39.795041 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.quota [None req-f6141674-b2e9-4f27-a675-3a1ee118fc49 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Getting quotas for user 20ef078fe46d418c95f35e1f0bdd2f2e and project a1b8f338b40e4d7e9a6249084bcdaa73. Resources: {'cores', 'instances', 'ram'} {{(pid=117858) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 07:02:39.814627 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-f6141674-b2e9-4f27-a675-3a1ee118fc49 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Going to run 1 instances... {{(pid=117858) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 07:02:39.818264 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-f6141674-b2e9-4f27-a675-3a1ee118fc49 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] [instance: 9883f029-68a3-4946-b14b-47721b72f3db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5d2c35cc-2f3b-4a22-bd68-79c71882b6a2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117858) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 07:02:39.946145 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-f6141674-b2e9-4f27-a675-3a1ee118fc49 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.908767 Aug 09 07:02:39.946827 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 16/32] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 9 07:02:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2910 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 07:02:39.960561 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-86e26718-a6f2-47a8-b418-a5596961ef32 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:02:39.960668 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-86e26718-a6f2-47a8-b418-a5596961ef32 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] [instance: 9883f029-68a3-4946-b14b-47721b72f3db] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:02:40.114735 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-86e26718-a6f2-47a8-b418-a5596961ef32 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef078fe46d418c95f35e1f0bdd2f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8f338b40e4d7e9a6249084bcdaa73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:02:40.136249 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-98889079-769c-4d11-a7a6-323199783e9e tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Action: 'create', calling method: .version_select at 0x7f20dfa8d550>, body: {"keypair": {"name": "tempest-keypair-2049758880", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC80++T4FhYxDfZua6qlIGgtOPFZUDVz/fpjpm1NzFewX+M5+eDV47LiKDki5t+caNUdku/6dC7a3j8ahlcuCaveCjMUXhNVbs15Q3ARfmHRsGRYLxyHFtVF9uT2Nnmmyg=="}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:02:40.149721 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-86e26718-a6f2-47a8-b418-a5596961ef32 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] 10.222.0.30 "GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db" status: 200 len: 1214 microversion: 2.1 time: 0.193664 Aug 09 07:02:40.150870 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 17/33] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:02:39 2022] GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db => generated 1214 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:02:40.280609 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-98889079-769c-4d11-a7a6-323199783e9e tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Getting quotas for project b7ada2fd6ffa44df9345c13afb650496. Resources: {'key_pairs'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 07:02:40.312418 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-98889079-769c-4d11-a7a6-323199783e9e tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Getting quotas for user 4e528f53a4b94e0fab0d90e0dbe07216 and project b7ada2fd6ffa44df9345c13afb650496. Resources: {'key_pairs'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 07:02:40.487163 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-98889079-769c-4d11-a7a6-323199783e9e tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.233680 Aug 09 07:02:40.500876 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 17/34] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 9 07:02:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 07:02:40.513696 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-8207b4a2-6395-4675-9779-9c8524df1ce4 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-729767070", "imageRef": "5d2c35cc-2f3b-4a22-bd68-79c71882b6a2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "20e6e819-0a94-455d-a88e-5217530385f8"}], "security_groups": [{"name": "tempest-securitygroup--1746081172"}], "key_name": "tempest-keypair-1359303097", "user_data": "}} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:02:41.084300 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.network.neutron [None req-8207b4a2-6395-4675-9779-9c8524df1ce4 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] validate_networks() for [('20e6e819-0a94-455d-a88e-5217530385f8', None, None, None, None, None)] {{(pid=117858) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 07:02:41.171517 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-45e2f768-f8e0-4531-b5bc-9842780d9823 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:02:41.173137 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-45e2f768-f8e0-4531-b5bc-9842780d9823 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] [instance: 9883f029-68a3-4946-b14b-47721b72f3db] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:02:41.487313 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-45e2f768-f8e0-4531-b5bc-9842780d9823 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef078fe46d418c95f35e1f0bdd2f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8f338b40e4d7e9a6249084bcdaa73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:02:41.517705 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-45e2f768-f8e0-4531-b5bc-9842780d9823 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] 10.222.0.30 "GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db" status: 200 len: 1214 microversion: 2.1 time: 0.350692 Aug 09 07:02:41.525094 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 18/35] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:02:41 2022] GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db => generated 1214 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:02:42.672597 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.virt.hardware [None req-8207b4a2-6395-4675-9779-9c8524df1ce4 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Flavor limits 0:0:0 {{(pid=117858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 07:02:42.674087 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.virt.hardware [None req-8207b4a2-6395-4675-9779-9c8524df1ce4 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Image limits 0:0:0 {{(pid=117858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 07:02:42.675033 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.virt.hardware [None req-8207b4a2-6395-4675-9779-9c8524df1ce4 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Flavor pref 0:0:0 {{(pid=117858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 07:02:42.675775 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.virt.hardware [None req-8207b4a2-6395-4675-9779-9c8524df1ce4 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Image pref 0:0:0 {{(pid=117858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 07:02:42.676351 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.virt.hardware [None req-8207b4a2-6395-4675-9779-9c8524df1ce4 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 07:02:42.727213 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-8207b4a2-6395-4675-9779-9c8524df1ce4 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:02:42.731936 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-8207b4a2-6395-4675-9779-9c8524df1ce4 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:02:42.732851 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-8207b4a2-6395-4675-9779-9c8524df1ce4 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:02:42.735052 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-8207b4a2-6395-4675-9779-9c8524df1ce4 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:02:42.736985 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-8207b4a2-6395-4675-9779-9c8524df1ce4 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:02:42.738026 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-8207b4a2-6395-4675-9779-9c8524df1ce4 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:02:42.792712 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.quota [None req-8207b4a2-6395-4675-9779-9c8524df1ce4 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Getting quotas for project f38c6aa37b9643bbbe5bb7fd3efde4fd. Resources: {'cores', 'instances', 'ram'} {{(pid=117858) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 07:02:42.817485 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.quota [None req-8207b4a2-6395-4675-9779-9c8524df1ce4 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Getting quotas for user cc885026afe041cca086367bb67d8a9b and project f38c6aa37b9643bbbe5bb7fd3efde4fd. Resources: {'cores', 'instances', 'ram'} {{(pid=117858) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 07:02:42.867286 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-8207b4a2-6395-4675-9779-9c8524df1ce4 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Going to run 1 instances... {{(pid=117858) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 07:02:42.890750 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-8207b4a2-6395-4675-9779-9c8524df1ce4 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: 66d40f73-633e-4564-a6d4-732cd15dcb12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5d2c35cc-2f3b-4a22-bd68-79c71882b6a2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117858) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 07:02:43.013579 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-8207b4a2-6395-4675-9779-9c8524df1ce4 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.505363 Aug 09 07:02:43.015363 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 18/36] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 9 07:02:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 2508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 07:02:43.317359 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-45d19de6-f136-4d97-ba9a-193bef448a57 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Action: 'create', calling method: .version_select at 0x7f20df130670>, body: {"keypair": {"name": "tempest-keypair-917474738", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2Lyjh5gUQrur4OKV9O/G8L49ZAv88ehGItVKoVd6fgXTVm9vD1C1NuKuRxbhLFukz/MXcnboM0RA06AA3f07Ckg09NJONjWmmUGS5QXGpYP3w2v3EfUrIgKgQB0E2Smg=="}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:02:43.369748 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-45d19de6-f136-4d97-ba9a-193bef448a57 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Getting quotas for project 10c7e20a9669439fa43853dab6f9851c. Resources: {'key_pairs'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 07:02:43.378917 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-45d19de6-f136-4d97-ba9a-193bef448a57 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Getting quotas for user 0bb72c5f52fc498aa60eecba3bd5248a and project 10c7e20a9669439fa43853dab6f9851c. Resources: {'key_pairs'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 07:02:43.436134 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-45d19de6-f136-4d97-ba9a-193bef448a57 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.270795 Aug 09 07:02:43.437106 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 19/37] 10.222.0.30 () {62 vars in 1200 bytes} [Tue Aug 9 07:02:42 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1272 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 09 07:02:43.441621 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-757b25cc-9a65-4520-a3a7-f578b01f4fc9 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:02:43.442234 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-757b25cc-9a65-4520-a3a7-f578b01f4fc9 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] [instance: 9883f029-68a3-4946-b14b-47721b72f3db] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:02:43.469102 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-64a07771-6a57-46d6-84b1-d45f62ee7605 tempest-VolumesNegativeTest-1680355727 tempest-VolumesNegativeTest-1680355727-project] Action: 'create', calling method: .version_select at 0x7f20de8c8f70>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1013861249", "metadata": {"Type": "work"}}} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:02:43.474090 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-64a07771-6a57-46d6-84b1-d45f62ee7605 tempest-VolumesNegativeTest-1680355727 tempest-VolumesNegativeTest-1680355727-project] Request method failure captured: Aug 09 07:02:43.474090 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 09 07:02:43.474090 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Accept: application/json Aug 09 07:02:43.474090 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Accept-Encoding: identity Aug 09 07:02:43.474090 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Connection: close Aug 09 07:02:43.474090 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Content-Length: 122 Aug 09 07:02:43.474090 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Content-Type: application/json Aug 09 07:02:43.474090 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Host: 10.222.0.30 Aug 09 07:02:43.474090 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Openstack-System-Scope: None Aug 09 07:02:43.474090 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: User-Agent: python-urllib3/1.26.11 Aug 09 07:02:43.474090 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Auth-Token: gAAAAABi8gaSzAH3u5kgRJtw5uYoBdXyNkJWpcC3bwmZBcnvIX1fsfQpM027HqPCil-PiOwwKOJP01BWW0gi94KuYGmn83zEPQWK9-YwaRuj_c4cpueLBhLXJo7sFsg95G8s49yz9v10l0sSLvO3hFW3oe8CH9sG1b8xMa0arua80QQ8672-1Ac Aug 09 07:02:43.474090 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Domain-Id: None Aug 09 07:02:43.474090 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Domain-Name: None Aug 09 07:02:43.474090 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Identity-Status: Confirmed Aug 09 07:02:43.474090 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Is-Admin-Project: True Aug 09 07:02:43.474090 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Domain-Id: default Aug 09 07:02:43.474090 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Domain-Name: Default Aug 09 07:02:43.474090 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Id: c2648d1bb6e94dbe8b5a7a877de3080c Aug 09 07:02:43.474090 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Name: tempest-VolumesNegativeTest-1680355727 Aug 09 07:02:43.474090 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Role: reader,member Aug 09 07:02:43.474090 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Roles: reader,member Aug 09 07:02:43.475513 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c2648d1bb6e94dbe8b5a7a877de3080c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c2648d1bb6e94dbe8b5a7a877de3080c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c2648d1bb6e94dbe8b5a7a877de3080c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c2648d1bb6e94dbe8b5a7a877de3080c"}]}] Aug 09 07:02:43.475513 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant: tempest-VolumesNegativeTest-1680355727 Aug 09 07:02:43.475513 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant-Id: c2648d1bb6e94dbe8b5a7a877de3080c Aug 09 07:02:43.475513 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant-Name: tempest-VolumesNegativeTest-1680355727 Aug 09 07:02:43.475513 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User: tempest-VolumesNegativeTest-1680355727-project Aug 09 07:02:43.475513 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Domain-Id: default Aug 09 07:02:43.475513 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Domain-Name: Default Aug 09 07:02:43.475513 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Id: 5f8894118c8b4c0bb412e5a8d05f020f Aug 09 07:02:43.475513 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Name: tempest-VolumesNegativeTest-1680355727-project Aug 09 07:02:43.475513 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Aug 09 07:02:43.475513 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1013861249", "metadata": {"Type": "work"}}} Aug 09 07:02:43.475513 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: method: Aug 09 07:02:43.475513 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 09 07:02:43.476660 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1013861249', 'metadata': {'Type': 'work'}}}} Aug 09 07:02:43.476660 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 07:02:43.476660 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:02:43.476660 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 07:02:43.476660 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 07:02:43.476660 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 07:02:43.476660 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise error Aug 09 07:02:43.476660 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 09 07:02:43.476660 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:02:43.476660 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 09 07:02:43.476660 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 09 07:02:43.476660 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:02:43.476660 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 09 07:02:43.476660 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi '#$%' Aug 09 07:02:43.476660 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:02:43.476660 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:02:43.476660 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:02:43.476660 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:02:43.476660 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:02:43.476660 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:02:43.476660 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 07:02:43.476660 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 07:02:43.479359 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 07:02:43.479359 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 07:02:43.479359 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 07:02:43.479359 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 07:02:43.479359 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 07:02:43.479359 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 07:02:43.479359 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 07:02:43.479359 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 07:02:43.479359 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 07:02:43.479359 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 07:02:43.479359 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 09 07:02:43.479359 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:02:43.479359 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:02:43.479359 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:02:43.479359 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:02:43.479359 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:02:43.479359 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:02:43.479359 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 07:02:43.479359 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 07:02:43.480554 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 09 07:02:43.480554 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:02:43.480554 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-64a07771-6a57-46d6-84b1-d45f62ee7605 tempest-VolumesNegativeTest-1680355727 tempest-VolumesNegativeTest-1680355727-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 07:02:43.480554 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-64a07771-6a57-46d6-84b1-d45f62ee7605 tempest-VolumesNegativeTest-1680355727 tempest-VolumesNegativeTest-1680355727-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.457255 Aug 09 07:02:43.480554 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 19/38] 10.222.0.30 () {60 vars in 1156 bytes} [Tue Aug 9 07:02:43 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 461 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 07:02:43.499962 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-757b25cc-9a65-4520-a3a7-f578b01f4fc9 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:02:43.500461 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-757b25cc-9a65-4520-a3a7-f578b01f4fc9 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:02:43.500910 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-757b25cc-9a65-4520-a3a7-f578b01f4fc9 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:02:43.501615 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-757b25cc-9a65-4520-a3a7-f578b01f4fc9 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:02:43.502663 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-757b25cc-9a65-4520-a3a7-f578b01f4fc9 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:02:43.503237 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-757b25cc-9a65-4520-a3a7-f578b01f4fc9 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:02:43.835387 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-0ff365bd-9bde-45dd-baab-81aeb135060e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1787873307", "imageRef": "5d2c35cc-2f3b-4a22-bd68-79c71882b6a2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:02:44.002925 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.network.neutron [None req-0ff365bd-9bde-45dd-baab-81aeb135060e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] validate_networks() for [('d7e85fb1-c62e-45ad-a928-60556e6bf8a9', None, None, None, None, None)] {{(pid=117858) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 07:02:44.314123 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-757b25cc-9a65-4520-a3a7-f578b01f4fc9 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef078fe46d418c95f35e1f0bdd2f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8f338b40e4d7e9a6249084bcdaa73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:02:44.350064 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-757b25cc-9a65-4520-a3a7-f578b01f4fc9 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] 10.222.0.30 "GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db" status: 200 len: 1266 microversion: 2.1 time: 0.911347 Aug 09 07:02:44.350722 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 20/39] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:02:43 2022] GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db => generated 1266 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:02:44.409769 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-86ac0564-2cfb-46ee-bfd0-2936c2e7a0d9 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:02:44.409769 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-86ac0564-2cfb-46ee-bfd0-2936c2e7a0d9 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: 66d40f73-633e-4564-a6d4-732cd15dcb12] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:02:44.685150 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-86ac0564-2cfb-46ee-bfd0-2936c2e7a0d9 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:02:44.692124 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-86ac0564-2cfb-46ee-bfd0-2936c2e7a0d9 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12" status: 200 len: 1241 microversion: 2.1 time: 0.340815 Aug 09 07:02:44.695183 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 21/40] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:02:44 2022] GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12 => generated 1241 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:02:44.708015 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-dfed4d7d-902f-4560-b462-1c5aaf9eb27f tempest-VolumesNegativeTest-1680355727 tempest-VolumesNegativeTest-1680355727-project] Action: 'create', calling method: .version_select at 0x7f20df08d820>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1125791361", "metadata": {"Type": "work"}}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:02:44.723135 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-dfed4d7d-902f-4560-b462-1c5aaf9eb27f tempest-VolumesNegativeTest-1680355727 tempest-VolumesNegativeTest-1680355727-project] Request method failure captured: Aug 09 07:02:44.723135 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 09 07:02:44.723135 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 09 07:02:44.723135 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 09 07:02:44.723135 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Connection: close Aug 09 07:02:44.723135 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Length: 120 Aug 09 07:02:44.723135 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 09 07:02:44.723135 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.30 Aug 09 07:02:44.723135 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 09 07:02:44.723135 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.11 Aug 09 07:02:44.723135 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi8gaSzAH3u5kgRJtw5uYoBdXyNkJWpcC3bwmZBcnvIX1fsfQpM027HqPCil-PiOwwKOJP01BWW0gi94KuYGmn83zEPQWK9-YwaRuj_c4cpueLBhLXJo7sFsg95G8s49yz9v10l0sSLvO3hFW3oe8CH9sG1b8xMa0arua80QQ8672-1Ac Aug 09 07:02:44.723135 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 09 07:02:44.723135 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 09 07:02:44.723135 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 09 07:02:44.723135 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 09 07:02:44.723135 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 09 07:02:44.723135 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 09 07:02:44.723135 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Id: c2648d1bb6e94dbe8b5a7a877de3080c Aug 09 07:02:44.723135 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-VolumesNegativeTest-1680355727 Aug 09 07:02:44.723135 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 09 07:02:44.723135 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 09 07:02:44.724355 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c2648d1bb6e94dbe8b5a7a877de3080c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c2648d1bb6e94dbe8b5a7a877de3080c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c2648d1bb6e94dbe8b5a7a877de3080c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c2648d1bb6e94dbe8b5a7a877de3080c"}]}] Aug 09 07:02:44.724355 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-VolumesNegativeTest-1680355727 Aug 09 07:02:44.724355 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: c2648d1bb6e94dbe8b5a7a877de3080c Aug 09 07:02:44.724355 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-VolumesNegativeTest-1680355727 Aug 09 07:02:44.724355 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User: tempest-VolumesNegativeTest-1680355727-project Aug 09 07:02:44.724355 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 09 07:02:44.724355 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 09 07:02:44.724355 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Id: 5f8894118c8b4c0bb412e5a8d05f020f Aug 09 07:02:44.724355 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-VolumesNegativeTest-1680355727-project Aug 09 07:02:44.724355 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Aug 09 07:02:44.724355 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1125791361", "metadata": {"Type": "work"}}} Aug 09 07:02:44.724355 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: method: Aug 09 07:02:44.724355 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 09 07:02:44.725028 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1125791361', 'metadata': {'Type': 'work'}}}} Aug 09 07:02:44.725028 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 07:02:44.725028 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:02:44.725028 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 07:02:44.725028 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 07:02:44.725028 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 07:02:44.725028 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise error Aug 09 07:02:44.725028 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 09 07:02:44.725028 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:02:44.725028 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 09 07:02:44.725028 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 09 07:02:44.725028 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:02:44.725028 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 09 07:02:44.725028 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi '0' Aug 09 07:02:44.725028 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:02:44.725028 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:02:44.725028 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:02:44.725028 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:02:44.725028 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:02:44.725028 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:02:44.725028 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 07:02:44.725028 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 07:02:44.726082 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 07:02:44.726082 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 07:02:44.726082 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 07:02:44.726082 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 07:02:44.726082 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 07:02:44.726082 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 07:02:44.726082 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 07:02:44.726082 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 07:02:44.726082 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 07:02:44.726082 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 07:02:44.726082 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 09 07:02:44.726082 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:02:44.726082 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:02:44.726082 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:02:44.726082 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:02:44.726082 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:02:44.726082 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:02:44.726082 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 07:02:44.726082 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 07:02:44.727006 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 09 07:02:44.727006 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:02:44.732966 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-dfed4d7d-902f-4560-b462-1c5aaf9eb27f tempest-VolumesNegativeTest-1680355727 tempest-VolumesNegativeTest-1680355727-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 07:02:44.736760 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-dfed4d7d-902f-4560-b462-1c5aaf9eb27f tempest-VolumesNegativeTest-1680355727 tempest-VolumesNegativeTest-1680355727-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.040333 Aug 09 07:02:44.738897 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 22/41] 10.222.0.30 () {60 vars in 1156 bytes} [Tue Aug 9 07:02:44 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 07:02:44.768552 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e2f85e41-489e-4e99-a4eb-a772ad8f4716 tempest-VolumesNegativeTest-1680355727 tempest-VolumesNegativeTest-1680355727-project] Action: 'create', calling method: .version_select at 0x7f20dfa8da60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1759298726", "metadata": {"Type": "work"}}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:02:44.780133 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e2f85e41-489e-4e99-a4eb-a772ad8f4716 tempest-VolumesNegativeTest-1680355727 tempest-VolumesNegativeTest-1680355727-project] Request method failure captured: Aug 09 07:02:44.780133 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 09 07:02:44.780133 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 09 07:02:44.780133 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 09 07:02:44.780133 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Connection: close Aug 09 07:02:44.780133 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Length: 119 Aug 09 07:02:44.780133 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 09 07:02:44.780133 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.30 Aug 09 07:02:44.780133 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 09 07:02:44.780133 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.11 Aug 09 07:02:44.780133 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi8gaSzAH3u5kgRJtw5uYoBdXyNkJWpcC3bwmZBcnvIX1fsfQpM027HqPCil-PiOwwKOJP01BWW0gi94KuYGmn83zEPQWK9-YwaRuj_c4cpueLBhLXJo7sFsg95G8s49yz9v10l0sSLvO3hFW3oe8CH9sG1b8xMa0arua80QQ8672-1Ac Aug 09 07:02:44.780133 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 09 07:02:44.780133 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 09 07:02:44.780133 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 09 07:02:44.780133 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 09 07:02:44.780133 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 09 07:02:44.780133 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 09 07:02:44.780133 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Id: c2648d1bb6e94dbe8b5a7a877de3080c Aug 09 07:02:44.780133 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-VolumesNegativeTest-1680355727 Aug 09 07:02:44.780133 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 09 07:02:44.780133 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 09 07:02:44.782090 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c2648d1bb6e94dbe8b5a7a877de3080c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c2648d1bb6e94dbe8b5a7a877de3080c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c2648d1bb6e94dbe8b5a7a877de3080c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c2648d1bb6e94dbe8b5a7a877de3080c"}]}] Aug 09 07:02:44.782090 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-VolumesNegativeTest-1680355727 Aug 09 07:02:44.782090 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: c2648d1bb6e94dbe8b5a7a877de3080c Aug 09 07:02:44.782090 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-VolumesNegativeTest-1680355727 Aug 09 07:02:44.782090 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User: tempest-VolumesNegativeTest-1680355727-project Aug 09 07:02:44.782090 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 09 07:02:44.782090 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 09 07:02:44.782090 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Id: 5f8894118c8b4c0bb412e5a8d05f020f Aug 09 07:02:44.782090 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-VolumesNegativeTest-1680355727-project Aug 09 07:02:44.782090 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Aug 09 07:02:44.782090 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1759298726", "metadata": {"Type": "work"}}} Aug 09 07:02:44.782090 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: method: Aug 09 07:02:44.782090 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 09 07:02:44.782745 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1759298726', 'metadata': {'Type': 'work'}}}} Aug 09 07:02:44.782745 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 07:02:44.782745 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:02:44.782745 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 09 07:02:44.782745 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 09 07:02:44.782745 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 09 07:02:44.782745 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise error Aug 09 07:02:44.782745 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 09 07:02:44.782745 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:02:44.782745 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 09 07:02:44.782745 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 09 07:02:44.782745 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:02:44.782745 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 09 07:02:44.782745 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi '' Aug 09 07:02:44.782745 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:02:44.782745 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:02:44.782745 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:02:44.782745 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:02:44.782745 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:02:44.782745 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:02:44.782745 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 07:02:44.782745 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 07:02:44.783820 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 07:02:44.783820 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 07:02:44.783820 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 07:02:44.783820 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 07:02:44.783820 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 09 07:02:44.783820 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 09 07:02:44.783820 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 09 07:02:44.783820 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 09 07:02:44.783820 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 09 07:02:44.783820 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 09 07:02:44.783820 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 09 07:02:44.783820 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:02:44.783820 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:02:44.783820 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:02:44.783820 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:02:44.783820 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:02:44.783820 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:02:44.783820 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 09 07:02:44.783820 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 09 07:02:44.784696 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 09 07:02:44.784696 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:02:44.796459 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e2f85e41-489e-4e99-a4eb-a772ad8f4716 tempest-VolumesNegativeTest-1680355727 tempest-VolumesNegativeTest-1680355727-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 07:02:44.797315 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-e2f85e41-489e-4e99-a4eb-a772ad8f4716 tempest-VolumesNegativeTest-1680355727 tempest-VolumesNegativeTest-1680355727-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.050085 Aug 09 07:02:44.797997 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 23/42] 10.222.0.30 () {60 vars in 1156 bytes} [Tue Aug 9 07:02:44 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 07:02:44.812681 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a98e6609-dcdf-4968-9a72-a13befe95309 tempest-VolumesNegativeTest-1680355727 tempest-VolumesNegativeTest-1680355727-project] Calling method '.version_select at 0x7f20df1629d0>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:02:44.976557 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-a98e6609-dcdf-4968-9a72-a13befe95309 tempest-VolumesNegativeTest-1680355727 tempest-VolumesNegativeTest-1680355727-project] HTTP exception thrown: Volume tempest-invalid-998266710 could not be found. Aug 09 07:02:44.978851 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a98e6609-dcdf-4968-9a72-a13befe95309 tempest-VolumesNegativeTest-1680355727 tempest-VolumesNegativeTest-1680355727-project] Request method failure captured: Aug 09 07:02:44.978851 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-998266710 HTTP/1.1 Aug 09 07:02:44.978851 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 09 07:02:44.978851 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 09 07:02:44.978851 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Connection: close Aug 09 07:02:44.978851 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Length: 0 Aug 09 07:02:44.978851 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 09 07:02:44.978851 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.30 Aug 09 07:02:44.978851 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 09 07:02:44.978851 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.11 Aug 09 07:02:44.978851 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi8gaSzAH3u5kgRJtw5uYoBdXyNkJWpcC3bwmZBcnvIX1fsfQpM027HqPCil-PiOwwKOJP01BWW0gi94KuYGmn83zEPQWK9-YwaRuj_c4cpueLBhLXJo7sFsg95G8s49yz9v10l0sSLvO3hFW3oe8CH9sG1b8xMa0arua80QQ8672-1Ac Aug 09 07:02:44.978851 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 09 07:02:44.978851 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 09 07:02:44.978851 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 09 07:02:44.978851 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 09 07:02:44.978851 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 09 07:02:44.978851 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 09 07:02:44.978851 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Id: c2648d1bb6e94dbe8b5a7a877de3080c Aug 09 07:02:44.978851 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-VolumesNegativeTest-1680355727 Aug 09 07:02:44.978851 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 09 07:02:44.978851 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 09 07:02:44.980157 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c2648d1bb6e94dbe8b5a7a877de3080c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c2648d1bb6e94dbe8b5a7a877de3080c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c2648d1bb6e94dbe8b5a7a877de3080c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c2648d1bb6e94dbe8b5a7a877de3080c"}]}] Aug 09 07:02:44.980157 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-VolumesNegativeTest-1680355727 Aug 09 07:02:44.980157 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: c2648d1bb6e94dbe8b5a7a877de3080c Aug 09 07:02:44.980157 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-VolumesNegativeTest-1680355727 Aug 09 07:02:44.980157 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User: tempest-VolumesNegativeTest-1680355727-project Aug 09 07:02:44.980157 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 09 07:02:44.980157 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 09 07:02:44.980157 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Id: 5f8894118c8b4c0bb412e5a8d05f020f Aug 09 07:02:44.980157 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-VolumesNegativeTest-1680355727-project Aug 09 07:02:44.980157 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: method: Aug 09 07:02:44.980157 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: exception: Volume tempest-invalid-998266710 could not be found. Aug 09 07:02:44.980157 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: action_args: {'id': 'tempest-invalid-998266710'} Aug 09 07:02:44.980157 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 07:02:44.980778 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:02:44.980778 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 07:02:44.980778 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 07:02:44.980778 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 07:02:44.980778 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 07:02:44.980778 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 07:02:44.980778 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 07:02:44.980778 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 07:02:44.980778 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 07:02:44.980778 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 07:02:44.980778 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 07:02:44.980778 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 07:02:44.980778 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 07:02:44.980778 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 07:02:44.980778 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 07:02:44.980778 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-998266710 could not be found. (HTTP 404) (Request-ID: req-bdfe480e-f8f2-438f-833f-6937d2669eb4) Aug 09 07:02:44.980778 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:02:44.980778 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:02:44.980778 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:02:44.982851 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:02:44.982851 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 09 07:02:44.982851 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 09 07:02:44.982851 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 07:02:44.982851 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 07:02:44.982851 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 07:02:44.982851 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 07:02:44.982851 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 07:02:44.982851 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 07:02:44.982851 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 07:02:44.982851 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 07:02:44.982851 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 07:02:44.982851 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 07:02:44.982851 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 07:02:44.982851 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 07:02:44.982851 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 07:02:44.982851 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 07:02:44.982851 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 07:02:44.982851 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 07:02:44.984703 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 07:02:44.984703 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 07:02:44.984703 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 07:02:44.984703 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 07:02:44.984703 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-998266710 could not be found. Aug 09 07:02:44.984703 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:02:44.984703 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:02:44.984703 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:02:44.984703 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:02:44.984703 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:02:44.984703 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:02:44.984703 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 07:02:44.984703 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 07:02:44.984703 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 07:02:44.984703 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 07:02:44.984703 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 07:02:44.984703 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 07:02:44.984703 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 09 07:02:44.984703 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 07:02:44.984703 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-998266710 could not be found. Aug 09 07:02:44.987086 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:02:44.987086 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:02:44.987086 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:02:44.987086 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:02:44.987086 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:02:44.987086 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:02:44.987086 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 07:02:44.987086 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 07:02:44.987086 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-998266710 could not be found. Aug 09 07:02:44.987086 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:02:44.987086 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a98e6609-dcdf-4968-9a72-a13befe95309 tempest-VolumesNegativeTest-1680355727 tempest-VolumesNegativeTest-1680355727-project] Returning 404 to user: Volume tempest-invalid-998266710 could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 07:02:44.987086 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-a98e6609-dcdf-4968-9a72-a13befe95309 tempest-VolumesNegativeTest-1680355727 tempest-VolumesNegativeTest-1680355727-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/tempest-invalid-998266710" status: 404 len: 98 microversion: 2.1 time: 0.171964 Aug 09 07:02:44.987086 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 24/43] 10.222.0.30 () {58 vars in 1215 bytes} [Tue Aug 9 07:02:44 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-998266710 => generated 98 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 09 07:02:45.010540 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-73ca60b7-9006-4a60-83dc-f12316e91aef tempest-VolumesNegativeTest-1680355727 tempest-VolumesNegativeTest-1680355727-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.016801 Aug 09 07:02:45.019988 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 25/44] 10.222.0.30 () {58 vars in 1140 bytes} [Tue Aug 9 07:02:44 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 09 07:02:45.032118 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-d5154593-2903-4336-ac1a-82f8bf27b4db tempest-VolumesNegativeTest-1680355727 tempest-VolumesNegativeTest-1680355727-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009857 Aug 09 07:02:45.051987 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 26/45] 10.222.0.30 () {58 vars in 1137 bytes} [Tue Aug 9 07:02:45 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 09 07:02:45.057385 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f5bb45e4-4c72-4e5d-b87e-b8b34551c408 tempest-VolumesNegativeTest-1680355727 tempest-VolumesNegativeTest-1680355727-project] Calling method '.version_select at 0x7f20df08d700>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:02:45.215935 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-f5bb45e4-4c72-4e5d-b87e-b8b34551c408 tempest-VolumesNegativeTest-1680355727 tempest-VolumesNegativeTest-1680355727-project] HTTP exception thrown: Volume 616fc7d5-8d31-4939-84d4-1408edbf3ea9 could not be found. Aug 09 07:02:45.217877 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f5bb45e4-4c72-4e5d-b87e-b8b34551c408 tempest-VolumesNegativeTest-1680355727 tempest-VolumesNegativeTest-1680355727-project] Request method failure captured: Aug 09 07:02:45.217877 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: request: DELETE /compute/v2.1/os-volumes/616fc7d5-8d31-4939-84d4-1408edbf3ea9 HTTP/1.1 Aug 09 07:02:45.217877 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 09 07:02:45.217877 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 09 07:02:45.217877 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Connection: close Aug 09 07:02:45.217877 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Length: 0 Aug 09 07:02:45.217877 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 09 07:02:45.217877 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.30 Aug 09 07:02:45.217877 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 09 07:02:45.217877 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.11 Aug 09 07:02:45.217877 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi8gaSzAH3u5kgRJtw5uYoBdXyNkJWpcC3bwmZBcnvIX1fsfQpM027HqPCil-PiOwwKOJP01BWW0gi94KuYGmn83zEPQWK9-YwaRuj_c4cpueLBhLXJo7sFsg95G8s49yz9v10l0sSLvO3hFW3oe8CH9sG1b8xMa0arua80QQ8672-1Ac Aug 09 07:02:45.217877 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 09 07:02:45.217877 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 09 07:02:45.217877 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 09 07:02:45.217877 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 09 07:02:45.217877 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 09 07:02:45.217877 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 09 07:02:45.217877 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Id: c2648d1bb6e94dbe8b5a7a877de3080c Aug 09 07:02:45.217877 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-VolumesNegativeTest-1680355727 Aug 09 07:02:45.217877 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 09 07:02:45.217877 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 09 07:02:45.219176 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c2648d1bb6e94dbe8b5a7a877de3080c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c2648d1bb6e94dbe8b5a7a877de3080c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c2648d1bb6e94dbe8b5a7a877de3080c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c2648d1bb6e94dbe8b5a7a877de3080c"}]}] Aug 09 07:02:45.219176 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-VolumesNegativeTest-1680355727 Aug 09 07:02:45.219176 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: c2648d1bb6e94dbe8b5a7a877de3080c Aug 09 07:02:45.219176 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-VolumesNegativeTest-1680355727 Aug 09 07:02:45.219176 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User: tempest-VolumesNegativeTest-1680355727-project Aug 09 07:02:45.219176 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 09 07:02:45.219176 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 09 07:02:45.219176 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Id: 5f8894118c8b4c0bb412e5a8d05f020f Aug 09 07:02:45.219176 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-VolumesNegativeTest-1680355727-project Aug 09 07:02:45.219176 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: method: Aug 09 07:02:45.219176 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: exception: Volume 616fc7d5-8d31-4939-84d4-1408edbf3ea9 could not be found. Aug 09 07:02:45.219176 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: action_args: {'id': '616fc7d5-8d31-4939-84d4-1408edbf3ea9'} Aug 09 07:02:45.219176 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 07:02:45.219989 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:02:45.219989 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 07:02:45.219989 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 07:02:45.219989 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 07:02:45.219989 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 07:02:45.219989 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 07:02:45.219989 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 07:02:45.219989 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 07:02:45.219989 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 07:02:45.219989 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 07:02:45.219989 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 07:02:45.219989 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 07:02:45.219989 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 07:02:45.219989 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 07:02:45.219989 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 07:02:45.219989 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 616fc7d5-8d31-4939-84d4-1408edbf3ea9 could not be found. (HTTP 404) (Request-ID: req-8a576ac7-d75b-492b-8a5b-06469e6c55dc) Aug 09 07:02:45.219989 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:02:45.219989 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:02:45.219989 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:02:45.220919 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:02:45.220919 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 09 07:02:45.220919 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 09 07:02:45.220919 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 07:02:45.220919 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 07:02:45.220919 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 07:02:45.220919 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 07:02:45.220919 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 07:02:45.220919 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 07:02:45.220919 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 07:02:45.220919 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 07:02:45.220919 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 09 07:02:45.220919 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 09 07:02:45.220919 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 09 07:02:45.220919 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 09 07:02:45.220919 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 09 07:02:45.220919 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 09 07:02:45.220919 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 09 07:02:45.220919 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 09 07:02:45.222927 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 07:02:45.222927 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 07:02:45.222927 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 07:02:45.222927 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 07:02:45.222927 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 616fc7d5-8d31-4939-84d4-1408edbf3ea9 could not be found. Aug 09 07:02:45.222927 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:02:45.222927 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:02:45.222927 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:02:45.222927 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:02:45.222927 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:02:45.222927 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:02:45.222927 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 07:02:45.222927 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 07:02:45.222927 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 07:02:45.222927 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 07:02:45.222927 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 07:02:45.222927 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 07:02:45.222927 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 09 07:02:45.222927 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 07:02:45.226252 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 616fc7d5-8d31-4939-84d4-1408edbf3ea9 could not be found. Aug 09 07:02:45.226252 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:02:45.226252 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:02:45.226252 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:02:45.226252 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:02:45.226252 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:02:45.226252 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:02:45.226252 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 07:02:45.226252 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 07:02:45.226252 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 616fc7d5-8d31-4939-84d4-1408edbf3ea9 could not be found. Aug 09 07:02:45.226252 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:02:45.226252 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f5bb45e4-4c72-4e5d-b87e-b8b34551c408 tempest-VolumesNegativeTest-1680355727 tempest-VolumesNegativeTest-1680355727-project] Returning 404 to user: Volume 616fc7d5-8d31-4939-84d4-1408edbf3ea9 could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 07:02:45.226252 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f5bb45e4-4c72-4e5d-b87e-b8b34551c408 tempest-VolumesNegativeTest-1680355727 tempest-VolumesNegativeTest-1680355727-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/616fc7d5-8d31-4939-84d4-1408edbf3ea9" status: 404 len: 109 microversion: 2.1 time: 0.166097 Aug 09 07:02:45.226252 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 27/46] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Aug 9 07:02:45 2022] DELETE /compute/v2.1/os-volumes/616fc7d5-8d31-4939-84d4-1408edbf3ea9 => generated 109 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 07:02:45.231208 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a946bfac-6c3c-470e-93db-4d8d5b4b436d tempest-VolumesNegativeTest-1680355727 tempest-VolumesNegativeTest-1680355727-project] Calling method '.version_select at 0x7f20df08db80>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:02:45.330647 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-a946bfac-6c3c-470e-93db-4d8d5b4b436d tempest-VolumesNegativeTest-1680355727 tempest-VolumesNegativeTest-1680355727-project] HTTP exception thrown: Volume dae34545-2694-4c0d-b0a9-45fdb572648b could not be found. Aug 09 07:02:45.332741 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a946bfac-6c3c-470e-93db-4d8d5b4b436d tempest-VolumesNegativeTest-1680355727 tempest-VolumesNegativeTest-1680355727-project] Request method failure captured: Aug 09 07:02:45.332741 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/os-volumes/dae34545-2694-4c0d-b0a9-45fdb572648b HTTP/1.1 Aug 09 07:02:45.332741 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 09 07:02:45.332741 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 09 07:02:45.332741 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Connection: close Aug 09 07:02:45.332741 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Length: 0 Aug 09 07:02:45.332741 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 09 07:02:45.332741 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.30 Aug 09 07:02:45.332741 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 09 07:02:45.332741 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.11 Aug 09 07:02:45.332741 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi8gaSzAH3u5kgRJtw5uYoBdXyNkJWpcC3bwmZBcnvIX1fsfQpM027HqPCil-PiOwwKOJP01BWW0gi94KuYGmn83zEPQWK9-YwaRuj_c4cpueLBhLXJo7sFsg95G8s49yz9v10l0sSLvO3hFW3oe8CH9sG1b8xMa0arua80QQ8672-1Ac Aug 09 07:02:45.332741 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 09 07:02:45.332741 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 09 07:02:45.332741 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 09 07:02:45.332741 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 09 07:02:45.332741 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 09 07:02:45.332741 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 09 07:02:45.332741 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Id: c2648d1bb6e94dbe8b5a7a877de3080c Aug 09 07:02:45.332741 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-VolumesNegativeTest-1680355727 Aug 09 07:02:45.332741 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 09 07:02:45.332741 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 09 07:02:45.333825 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c2648d1bb6e94dbe8b5a7a877de3080c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_c2648d1bb6e94dbe8b5a7a877de3080c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/c2648d1bb6e94dbe8b5a7a877de3080c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/c2648d1bb6e94dbe8b5a7a877de3080c"}]}] Aug 09 07:02:45.333825 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-VolumesNegativeTest-1680355727 Aug 09 07:02:45.333825 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: c2648d1bb6e94dbe8b5a7a877de3080c Aug 09 07:02:45.333825 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-VolumesNegativeTest-1680355727 Aug 09 07:02:45.333825 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User: tempest-VolumesNegativeTest-1680355727-project Aug 09 07:02:45.333825 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 09 07:02:45.333825 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 09 07:02:45.333825 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Id: 5f8894118c8b4c0bb412e5a8d05f020f Aug 09 07:02:45.333825 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-VolumesNegativeTest-1680355727-project Aug 09 07:02:45.333825 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: method: Aug 09 07:02:45.333825 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: exception: Volume dae34545-2694-4c0d-b0a9-45fdb572648b could not be found. Aug 09 07:02:45.333825 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: action_args: {'id': 'dae34545-2694-4c0d-b0a9-45fdb572648b'} Aug 09 07:02:45.333825 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 07:02:45.334600 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:02:45.334600 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 07:02:45.334600 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 07:02:45.334600 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 07:02:45.334600 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 07:02:45.334600 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 07:02:45.334600 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 07:02:45.334600 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 07:02:45.334600 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 07:02:45.334600 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 07:02:45.334600 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 07:02:45.334600 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 07:02:45.334600 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 07:02:45.334600 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 07:02:45.334600 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 07:02:45.334600 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dae34545-2694-4c0d-b0a9-45fdb572648b could not be found. (HTTP 404) (Request-ID: req-591abbf2-83ae-4dfe-81d2-279fa79bbff6) Aug 09 07:02:45.334600 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:02:45.334600 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:02:45.334600 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:02:45.335525 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:02:45.335525 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 09 07:02:45.335525 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 09 07:02:45.335525 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 07:02:45.335525 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 07:02:45.335525 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 07:02:45.335525 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 07:02:45.335525 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 07:02:45.335525 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 07:02:45.335525 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 07:02:45.335525 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 07:02:45.335525 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 07:02:45.335525 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 07:02:45.335525 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 07:02:45.335525 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 07:02:45.335525 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 07:02:45.335525 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 07:02:45.335525 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 07:02:45.335525 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 07:02:45.336498 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 07:02:45.336498 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 07:02:45.336498 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 07:02:45.336498 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 07:02:45.336498 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dae34545-2694-4c0d-b0a9-45fdb572648b could not be found. Aug 09 07:02:45.336498 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:02:45.336498 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:02:45.336498 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:02:45.336498 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:02:45.336498 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:02:45.336498 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:02:45.336498 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 07:02:45.336498 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 07:02:45.336498 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 07:02:45.336498 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 07:02:45.336498 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 07:02:45.336498 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 07:02:45.336498 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 09 07:02:45.336498 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 07:02:45.338016 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dae34545-2694-4c0d-b0a9-45fdb572648b could not be found. Aug 09 07:02:45.338016 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:02:45.338016 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:02:45.338016 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:02:45.338016 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:02:45.338016 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:02:45.338016 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:02:45.338016 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 07:02:45.338016 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 07:02:45.338016 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dae34545-2694-4c0d-b0a9-45fdb572648b could not be found. Aug 09 07:02:45.338016 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:02:45.338016 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a946bfac-6c3c-470e-93db-4d8d5b4b436d tempest-VolumesNegativeTest-1680355727 tempest-VolumesNegativeTest-1680355727-project] Returning 404 to user: Volume dae34545-2694-4c0d-b0a9-45fdb572648b could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 07:02:45.338016 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-a946bfac-6c3c-470e-93db-4d8d5b4b436d tempest-VolumesNegativeTest-1680355727 tempest-VolumesNegativeTest-1680355727-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/dae34545-2694-4c0d-b0a9-45fdb572648b" status: 404 len: 109 microversion: 2.1 time: 0.108549 Aug 09 07:02:45.338016 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 28/47] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Aug 9 07:02:45 2022] GET /compute/v2.1/os-volumes/dae34545-2694-4c0d-b0a9-45fdb572648b => generated 109 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 07:02:45.376945 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c3ef6157-8484-4a95-80ed-7f0af303de51 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:02:45.377634 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c3ef6157-8484-4a95-80ed-7f0af303de51 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] [instance: 9883f029-68a3-4946-b14b-47721b72f3db] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:02:45.430184 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c3ef6157-8484-4a95-80ed-7f0af303de51 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:02:45.430958 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c3ef6157-8484-4a95-80ed-7f0af303de51 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:02:45.432170 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c3ef6157-8484-4a95-80ed-7f0af303de51 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:02:45.433139 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c3ef6157-8484-4a95-80ed-7f0af303de51 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:02:45.433829 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c3ef6157-8484-4a95-80ed-7f0af303de51 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:02:45.434874 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c3ef6157-8484-4a95-80ed-7f0af303de51 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:02:45.955845 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c3ef6157-8484-4a95-80ed-7f0af303de51 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef078fe46d418c95f35e1f0bdd2f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8f338b40e4d7e9a6249084bcdaa73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:02:45.969906 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c3ef6157-8484-4a95-80ed-7f0af303de51 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] 10.222.0.30 "GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db" status: 200 len: 1272 microversion: 2.1 time: 0.597858 Aug 09 07:02:45.972891 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 29/48] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:02:45 2022] GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db => generated 1272 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:02:45.989677 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-009a37a7-ea41-4acd-9833-3f24be4d21df tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:02:45.993373 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-009a37a7-ea41-4acd-9833-3f24be4d21df tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: 66d40f73-633e-4564-a6d4-732cd15dcb12] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:02:46.010393 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-009a37a7-ea41-4acd-9833-3f24be4d21df tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:02:46.011070 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-009a37a7-ea41-4acd-9833-3f24be4d21df tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:02:46.011918 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-009a37a7-ea41-4acd-9833-3f24be4d21df tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:02:46.012835 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-009a37a7-ea41-4acd-9833-3f24be4d21df tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:02:46.013685 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-009a37a7-ea41-4acd-9833-3f24be4d21df tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:02:46.014343 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-009a37a7-ea41-4acd-9833-3f24be4d21df tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:02:46.815214 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-009a37a7-ea41-4acd-9833-3f24be4d21df tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:02:46.831345 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-009a37a7-ea41-4acd-9833-3f24be4d21df tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12" status: 200 len: 1293 microversion: 2.1 time: 0.852658 Aug 09 07:02:46.832862 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 30/49] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:02:45 2022] GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12 => generated 1293 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:02:46.993906 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-641cf4c9-8281-4f19-bca7-3436094a7126 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:02:46.995077 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-641cf4c9-8281-4f19-bca7-3436094a7126 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] [instance: 9883f029-68a3-4946-b14b-47721b72f3db] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:02:47.002765 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-641cf4c9-8281-4f19-bca7-3436094a7126 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:02:47.010009 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-641cf4c9-8281-4f19-bca7-3436094a7126 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:02:47.010994 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-641cf4c9-8281-4f19-bca7-3436094a7126 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:02:47.011958 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-641cf4c9-8281-4f19-bca7-3436094a7126 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:02:47.014254 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-641cf4c9-8281-4f19-bca7-3436094a7126 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:02:47.014958 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-641cf4c9-8281-4f19-bca7-3436094a7126 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:02:47.242195 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-641cf4c9-8281-4f19-bca7-3436094a7126 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef078fe46d418c95f35e1f0bdd2f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8f338b40e4d7e9a6249084bcdaa73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:02:47.252963 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-641cf4c9-8281-4f19-bca7-3436094a7126 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] 10.222.0.30 "GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db" status: 200 len: 1272 microversion: 2.1 time: 0.263978 Aug 09 07:02:47.254172 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 31/50] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:02:46 2022] GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db => generated 1272 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:02:47.428979 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.virt.hardware [None req-0ff365bd-9bde-45dd-baab-81aeb135060e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Flavor limits 0:0:0 {{(pid=117858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 07:02:47.430013 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.virt.hardware [None req-0ff365bd-9bde-45dd-baab-81aeb135060e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Image limits 0:0:0 {{(pid=117858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 07:02:47.431613 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.virt.hardware [None req-0ff365bd-9bde-45dd-baab-81aeb135060e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Flavor pref 0:0:0 {{(pid=117858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 07:02:47.432291 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.virt.hardware [None req-0ff365bd-9bde-45dd-baab-81aeb135060e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Image pref 0:0:0 {{(pid=117858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 07:02:47.432913 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.virt.hardware [None req-0ff365bd-9bde-45dd-baab-81aeb135060e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 07:02:47.462521 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0ff365bd-9bde-45dd-baab-81aeb135060e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:02:47.468434 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0ff365bd-9bde-45dd-baab-81aeb135060e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:02:47.468641 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0ff365bd-9bde-45dd-baab-81aeb135060e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:02:47.469460 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0ff365bd-9bde-45dd-baab-81aeb135060e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:02:47.470049 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0ff365bd-9bde-45dd-baab-81aeb135060e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:02:47.470512 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0ff365bd-9bde-45dd-baab-81aeb135060e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:02:47.528858 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.quota [None req-0ff365bd-9bde-45dd-baab-81aeb135060e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Getting quotas for project 517f3dedc5da431b87e398003506c06b. Resources: {'cores', 'instances', 'ram'} {{(pid=117858) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 07:02:47.533279 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.quota [None req-0ff365bd-9bde-45dd-baab-81aeb135060e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Getting quotas for user 19da3c426c6e4c4a889ab5017804c92e and project 517f3dedc5da431b87e398003506c06b. Resources: {'cores', 'instances', 'ram'} {{(pid=117858) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 07:02:47.565006 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-0ff365bd-9bde-45dd-baab-81aeb135060e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Going to run 1 instances... {{(pid=117858) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 07:02:47.567215 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-0ff365bd-9bde-45dd-baab-81aeb135060e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 9fe62967-63ba-4d67-88c4-25e1c1d445fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5d2c35cc-2f3b-4a22-bd68-79c71882b6a2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117858) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 07:02:47.679307 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-0ff365bd-9bde-45dd-baab-81aeb135060e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.199719 Aug 09 07:02:47.682766 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 20/51] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 9 07:02:43 2022] POST /compute/v2.1/servers => generated 383 bytes in 4205 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 07:02:47.694850 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-606c5214-bce4-4c70-8ff9-4d4ceb59ff83 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:02:47.695795 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-606c5214-bce4-4c70-8ff9-4d4ceb59ff83 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 9fe62967-63ba-4d67-88c4-25e1c1d445fa] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:02:47.858612 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-e4d7c0a2-c7b6-478b-8d39-4a64041843a9 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:02:47.860054 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-e4d7c0a2-c7b6-478b-8d39-4a64041843a9 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: 66d40f73-633e-4564-a6d4-732cd15dcb12] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:02:47.875228 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e4d7c0a2-c7b6-478b-8d39-4a64041843a9 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:02:47.880270 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e4d7c0a2-c7b6-478b-8d39-4a64041843a9 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:02:47.886914 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e4d7c0a2-c7b6-478b-8d39-4a64041843a9 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:02:47.890570 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e4d7c0a2-c7b6-478b-8d39-4a64041843a9 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:02:47.891320 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e4d7c0a2-c7b6-478b-8d39-4a64041843a9 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:02:47.892006 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e4d7c0a2-c7b6-478b-8d39-4a64041843a9 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:02:48.215966 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-606c5214-bce4-4c70-8ff9-4d4ceb59ff83 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:02:48.237789 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-606c5214-bce4-4c70-8ff9-4d4ceb59ff83 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa" status: 200 len: 1222 microversion: 2.1 time: 0.547236 Aug 09 07:02:48.238504 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 32/52] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:02:47 2022] GET /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa => generated 1222 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:02:48.282284 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-61259d99-47e3-4820-8e2e-459e7c107924 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:02:48.284188 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-61259d99-47e3-4820-8e2e-459e7c107924 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] [instance: 9883f029-68a3-4946-b14b-47721b72f3db] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:02:48.337884 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-61259d99-47e3-4820-8e2e-459e7c107924 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:02:48.344891 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-61259d99-47e3-4820-8e2e-459e7c107924 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:02:48.348791 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-61259d99-47e3-4820-8e2e-459e7c107924 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:02:48.356964 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-61259d99-47e3-4820-8e2e-459e7c107924 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:02:48.357639 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-61259d99-47e3-4820-8e2e-459e7c107924 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:02:48.358139 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-61259d99-47e3-4820-8e2e-459e7c107924 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:02:49.131561 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-e4d7c0a2-c7b6-478b-8d39-4a64041843a9 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:02:49.149154 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-e4d7c0a2-c7b6-478b-8d39-4a64041843a9 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12" status: 200 len: 1299 microversion: 2.1 time: 1.294762 Aug 09 07:02:49.171332 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 21/53] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:02:47 2022] GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12 => generated 1299 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:02:49.192549 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-192b2c9d-2b29-4e11-99e9-c742beba7aa2 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-339351808", "imageRef": "5d2c35cc-2f3b-4a22-bd68-79c71882b6a2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:02:49.365686 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.network.neutron [None req-192b2c9d-2b29-4e11-99e9-c742beba7aa2 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] validate_networks() for [('d7e85fb1-c62e-45ad-a928-60556e6bf8a9', None, None, None, None, None)] {{(pid=117858) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 07:02:50.672244 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-61259d99-47e3-4820-8e2e-459e7c107924 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef078fe46d418c95f35e1f0bdd2f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8f338b40e4d7e9a6249084bcdaa73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:02:50.686568 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-61259d99-47e3-4820-8e2e-459e7c107924 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] 10.222.0.30 "GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db" status: 200 len: 1314 microversion: 2.1 time: 2.414518 Aug 09 07:02:50.695634 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 33/54] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:02:48 2022] GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db => generated 1314 bytes in 2417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:02:50.695634 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-673336a7-b5cc-4a56-842c-1bd7dcbf1bb4 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:02:50.696183 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-673336a7-b5cc-4a56-842c-1bd7dcbf1bb4 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: 66d40f73-633e-4564-a6d4-732cd15dcb12] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:02:50.705880 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-673336a7-b5cc-4a56-842c-1bd7dcbf1bb4 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:02:50.706394 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-673336a7-b5cc-4a56-842c-1bd7dcbf1bb4 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:02:50.707404 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-673336a7-b5cc-4a56-842c-1bd7dcbf1bb4 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:02:50.708314 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-673336a7-b5cc-4a56-842c-1bd7dcbf1bb4 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:02:50.708908 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-673336a7-b5cc-4a56-842c-1bd7dcbf1bb4 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:02:50.709498 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-673336a7-b5cc-4a56-842c-1bd7dcbf1bb4 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:02:50.914503 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-673336a7-b5cc-4a56-842c-1bd7dcbf1bb4 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:02:50.941815 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-673336a7-b5cc-4a56-842c-1bd7dcbf1bb4 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12" status: 200 len: 1299 microversion: 2.1 time: 0.235952 Aug 09 07:02:50.944354 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 34/55] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:02:50 2022] GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12 => generated 1299 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:02:50.968665 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-63bf04f7-4f3b-4c2c-8b3e-9e24a412bc45 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-410739834", "imageRef": "5d2c35cc-2f3b-4a22-bd68-79c71882b6a2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4d897412-7520-4330-bf22-421d8f4aaa42"}], "security_groups": [{"name": "tempest-securitygroup--1156417945"}], "key_name": "tempest-keypair-2049758880", "user_data": "}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:02:51.549998 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.network.neutron [None req-63bf04f7-4f3b-4c2c-8b3e-9e24a412bc45 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] validate_networks() for [('4d897412-7520-4330-bf22-421d8f4aaa42', None, None, None, None, None)] {{(pid=117859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 07:02:53.728713 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.virt.hardware [None req-192b2c9d-2b29-4e11-99e9-c742beba7aa2 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Flavor limits 0:0:0 {{(pid=117858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 07:02:53.730596 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.virt.hardware [None req-192b2c9d-2b29-4e11-99e9-c742beba7aa2 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Image limits 0:0:0 {{(pid=117858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 07:02:53.731273 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.virt.hardware [None req-192b2c9d-2b29-4e11-99e9-c742beba7aa2 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Flavor pref 0:0:0 {{(pid=117858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 07:02:53.731864 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.virt.hardware [None req-192b2c9d-2b29-4e11-99e9-c742beba7aa2 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Image pref 0:0:0 {{(pid=117858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 07:02:53.732448 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.virt.hardware [None req-192b2c9d-2b29-4e11-99e9-c742beba7aa2 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 07:02:53.758771 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-192b2c9d-2b29-4e11-99e9-c742beba7aa2 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:02:53.760027 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-192b2c9d-2b29-4e11-99e9-c742beba7aa2 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:02:53.762173 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-192b2c9d-2b29-4e11-99e9-c742beba7aa2 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:02:53.763289 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-192b2c9d-2b29-4e11-99e9-c742beba7aa2 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:02:53.764162 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-192b2c9d-2b29-4e11-99e9-c742beba7aa2 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:02:53.768386 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-192b2c9d-2b29-4e11-99e9-c742beba7aa2 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:02:53.794981 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.quota [None req-192b2c9d-2b29-4e11-99e9-c742beba7aa2 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Getting quotas for project 517f3dedc5da431b87e398003506c06b. Resources: {'cores', 'instances', 'ram'} {{(pid=117858) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 07:02:53.800979 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.quota [None req-192b2c9d-2b29-4e11-99e9-c742beba7aa2 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Getting quotas for user 19da3c426c6e4c4a889ab5017804c92e and project 517f3dedc5da431b87e398003506c06b. Resources: {'cores', 'instances', 'ram'} {{(pid=117858) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 07:02:53.824441 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-192b2c9d-2b29-4e11-99e9-c742beba7aa2 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Going to run 1 instances... {{(pid=117858) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 07:02:53.826903 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-192b2c9d-2b29-4e11-99e9-c742beba7aa2 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5d2c35cc-2f3b-4a22-bd68-79c71882b6a2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117858) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 07:02:53.953726 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-192b2c9d-2b29-4e11-99e9-c742beba7aa2 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.780201 Aug 09 07:02:53.963580 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 22/56] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 9 07:02:49 2022] POST /compute/v2.1/servers => generated 383 bytes in 4785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 07:02:53.970838 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-a8245833-17c2-4e4d-9f57-cceca7a46b8c tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:02:53.971477 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-a8245833-17c2-4e4d-9f57-cceca7a46b8c tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] [instance: 9883f029-68a3-4946-b14b-47721b72f3db] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:02:53.981125 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a8245833-17c2-4e4d-9f57-cceca7a46b8c tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:02:53.981627 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a8245833-17c2-4e4d-9f57-cceca7a46b8c tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:02:53.982077 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a8245833-17c2-4e4d-9f57-cceca7a46b8c tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:02:53.982847 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a8245833-17c2-4e4d-9f57-cceca7a46b8c tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:02:53.983699 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a8245833-17c2-4e4d-9f57-cceca7a46b8c tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:02:53.984189 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a8245833-17c2-4e4d-9f57-cceca7a46b8c tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:02:55.550636 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-a8245833-17c2-4e4d-9f57-cceca7a46b8c tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef078fe46d418c95f35e1f0bdd2f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8f338b40e4d7e9a6249084bcdaa73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:02:55.573875 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-a8245833-17c2-4e4d-9f57-cceca7a46b8c tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] 10.222.0.30 "GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db" status: 200 len: 1314 microversion: 2.1 time: 1.612926 Aug 09 07:02:55.579707 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 23/57] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:02:53 2022] GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db => generated 1314 bytes in 1622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:02:55.606965 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-2ad82147-c0a9-4768-91d3-a39e47dbc12f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:02:55.608270 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-2ad82147-c0a9-4768-91d3-a39e47dbc12f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: 66d40f73-633e-4564-a6d4-732cd15dcb12] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:02:55.620637 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=13 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:02:55.651128 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2ad82147-c0a9-4768-91d3-a39e47dbc12f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:02:55.652346 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2ad82147-c0a9-4768-91d3-a39e47dbc12f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:02:55.656315 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2ad82147-c0a9-4768-91d3-a39e47dbc12f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:02:55.658087 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2ad82147-c0a9-4768-91d3-a39e47dbc12f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:02:55.660618 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2ad82147-c0a9-4768-91d3-a39e47dbc12f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:02:55.663101 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2ad82147-c0a9-4768-91d3-a39e47dbc12f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:02:55.826255 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-63bf04f7-4f3b-4c2c-8b3e-9e24a412bc45 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Flavor limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 07:02:55.826774 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-63bf04f7-4f3b-4c2c-8b3e-9e24a412bc45 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Image limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 07:02:55.827179 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-63bf04f7-4f3b-4c2c-8b3e-9e24a412bc45 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Flavor pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 07:02:55.827587 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-63bf04f7-4f3b-4c2c-8b3e-9e24a412bc45 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Image pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 07:02:55.828959 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-63bf04f7-4f3b-4c2c-8b3e-9e24a412bc45 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 07:02:55.866903 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-63bf04f7-4f3b-4c2c-8b3e-9e24a412bc45 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:02:55.869971 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-63bf04f7-4f3b-4c2c-8b3e-9e24a412bc45 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:02:55.870955 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-63bf04f7-4f3b-4c2c-8b3e-9e24a412bc45 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:02:55.873167 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-63bf04f7-4f3b-4c2c-8b3e-9e24a412bc45 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:02:55.877880 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-63bf04f7-4f3b-4c2c-8b3e-9e24a412bc45 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:02:55.877880 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-63bf04f7-4f3b-4c2c-8b3e-9e24a412bc45 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:02:55.947912 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-63bf04f7-4f3b-4c2c-8b3e-9e24a412bc45 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Getting quotas for project b7ada2fd6ffa44df9345c13afb650496. Resources: {'cores', 'instances', 'ram'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 07:02:55.953939 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-63bf04f7-4f3b-4c2c-8b3e-9e24a412bc45 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Getting quotas for user 4e528f53a4b94e0fab0d90e0dbe07216 and project b7ada2fd6ffa44df9345c13afb650496. Resources: {'cores', 'instances', 'ram'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 07:02:55.969698 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-63bf04f7-4f3b-4c2c-8b3e-9e24a412bc45 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Going to run 1 instances... {{(pid=117859) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 07:02:55.972877 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-63bf04f7-4f3b-4c2c-8b3e-9e24a412bc45 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5d2c35cc-2f3b-4a22-bd68-79c71882b6a2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 07:02:56.142054 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-63bf04f7-4f3b-4c2c-8b3e-9e24a412bc45 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 5.195712 Aug 09 07:02:56.145332 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 35/58] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 9 07:02:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 5200 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 07:02:56.166284 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a9a4ae51-d3bf-4658-8e0d-ff9ce954f8f5 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:02:56.174076 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-a9a4ae51-d3bf-4658-8e0d-ff9ce954f8f5 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:02:56.216296 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a9a4ae51-d3bf-4658-8e0d-ff9ce954f8f5 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:02:56.217735 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a9a4ae51-d3bf-4658-8e0d-ff9ce954f8f5 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:02:56.227946 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a9a4ae51-d3bf-4658-8e0d-ff9ce954f8f5 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:02:56.229005 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a9a4ae51-d3bf-4658-8e0d-ff9ce954f8f5 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:02:56.229616 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a9a4ae51-d3bf-4658-8e0d-ff9ce954f8f5 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:02:56.230174 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a9a4ae51-d3bf-4658-8e0d-ff9ce954f8f5 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:02:56.913395 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-2ad82147-c0a9-4768-91d3-a39e47dbc12f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:02:56.926149 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-2ad82147-c0a9-4768-91d3-a39e47dbc12f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12" status: 200 len: 1367 microversion: 2.1 time: 1.343891 Aug 09 07:02:56.926731 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 24/59] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:02:55 2022] GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12 => generated 1367 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:02:57.082338 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-a9a4ae51-d3bf-4658-8e0d-ff9ce954f8f5 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:02:57.094880 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-a9a4ae51-d3bf-4658-8e0d-ff9ce954f8f5 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 200 len: 1273 microversion: 2.1 time: 0.947376 Aug 09 07:02:57.101816 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 36/60] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:02:56 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 1273 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:02:57.126962 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4f6f3eee-3db4-47e4-98d6-bf1f418073df tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2113476028", "imageRef": "5d2c35cc-2f3b-4a22-bd68-79c71882b6a2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0cace90e-712f-4834-be77-703a07a187a7"}], "security_groups": [{"name": "tempest-securitygroup--156193119"}], "key_name": "tempest-keypair-917474738", "user_data": "}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:02:57.469761 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [req-28c223b9-30f7-4ffe-974d-a0c2f5f6efd2 req-d4306978-c488-4da6-9595-7bc545e0f53a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9883f029-68a3-4946-b14b-47721b72f3db", "tag": "823c14f0-b1a9-4950-bf0e-c762cdeb2d8f"}]} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:02:57.518041 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-28c223b9-30f7-4ffe-974d-a0c2f5f6efd2 req-d4306978-c488-4da6-9595-7bc545e0f53a service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:02:57.520333 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-28c223b9-30f7-4ffe-974d-a0c2f5f6efd2 req-d4306978-c488-4da6-9595-7bc545e0f53a service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:02:57.523080 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-28c223b9-30f7-4ffe-974d-a0c2f5f6efd2 req-d4306978-c488-4da6-9595-7bc545e0f53a service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:02:57.548281 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.network.neutron [None req-4f6f3eee-3db4-47e4-98d6-bf1f418073df tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] validate_networks() for [('0cace90e-712f-4834-be77-703a07a187a7', None, None, None, None, None)] {{(pid=117859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 07:02:57.609864 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.compute.server_external_events [req-28c223b9-30f7-4ffe-974d-a0c2f5f6efd2 req-d4306978-c488-4da6-9595-7bc545e0f53a service nova] Creating event network-changed:823c14f0-b1a9-4950-bf0e-c762cdeb2d8f for instance 9883f029-68a3-4946-b14b-47721b72f3db on hv-cinder-85251 Aug 09 07:02:57.610404 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-28c223b9-30f7-4ffe-974d-a0c2f5f6efd2 req-d4306978-c488-4da6-9595-7bc545e0f53a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=117858) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 09 07:02:57.610795 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-28c223b9-30f7-4ffe-974d-a0c2f5f6efd2 req-d4306978-c488-4da6-9595-7bc545e0f53a service nova] Acquired lock "compute-rpcapi-router" {{(pid=117858) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 09 07:02:57.611897 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a527c69e-392e-43be-b394-a757a3323246 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:02:57.612363 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a527c69e-392e-43be-b394-a757a3323246 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:02:57.612794 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a527c69e-392e-43be-b394-a757a3323246 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:02:57.613522 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a527c69e-392e-43be-b394-a757a3323246 None None] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:02:57.613981 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a527c69e-392e-43be-b394-a757a3323246 None None] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:02:57.614406 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a527c69e-392e-43be-b394-a757a3323246 None None] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:02:57.673169 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.compute.rpcapi [None req-a527c69e-392e-43be-b394-a757a3323246 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 09 07:02:57.677923 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a527c69e-392e-43be-b394-a757a3323246 None None] Releasing lock "compute-rpcapi-router" {{(pid=117858) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 09 07:02:57.746259 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-a527c69e-392e-43be-b394-a757a3323246 None None] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.818277 Aug 09 07:02:57.748394 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 25/61] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:02:57.765590 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-cc5cba5b-e250-4972-bb06-1c96aa406923 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:02:57.769597 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-cc5cba5b-e250-4972-bb06-1c96aa406923 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:02:57.778781 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cc5cba5b-e250-4972-bb06-1c96aa406923 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:02:57.779955 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cc5cba5b-e250-4972-bb06-1c96aa406923 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:02:57.780635 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cc5cba5b-e250-4972-bb06-1c96aa406923 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:02:57.781550 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cc5cba5b-e250-4972-bb06-1c96aa406923 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:02:57.782498 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cc5cba5b-e250-4972-bb06-1c96aa406923 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:02:57.783323 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cc5cba5b-e250-4972-bb06-1c96aa406923 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:02:58.013591 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-cc5cba5b-e250-4972-bb06-1c96aa406923 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:02:58.033795 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-cc5cba5b-e250-4972-bb06-1c96aa406923 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1241 microversion: 2.1 time: 0.282731 Aug 09 07:02:58.035145 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 26/62] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:02:57 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1241 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:02:58.057211 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-6ee4c927-86e4-4f69-89b1-c4b313439580 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:02:58.060348 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-6ee4c927-86e4-4f69-89b1-c4b313439580 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] [instance: 9883f029-68a3-4946-b14b-47721b72f3db] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:02:58.102345 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6ee4c927-86e4-4f69-89b1-c4b313439580 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:02:58.103416 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6ee4c927-86e4-4f69-89b1-c4b313439580 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:02:58.103901 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6ee4c927-86e4-4f69-89b1-c4b313439580 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:02:58.104631 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6ee4c927-86e4-4f69-89b1-c4b313439580 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:02:58.113321 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6ee4c927-86e4-4f69-89b1-c4b313439580 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:02:58.113785 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6ee4c927-86e4-4f69-89b1-c4b313439580 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:02:58.440870 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-6ee4c927-86e4-4f69-89b1-c4b313439580 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef078fe46d418c95f35e1f0bdd2f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8f338b40e4d7e9a6249084bcdaa73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:02:58.456637 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-6ee4c927-86e4-4f69-89b1-c4b313439580 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] 10.222.0.30 "GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db" status: 200 len: 1314 microversion: 2.1 time: 0.417015 Aug 09 07:02:58.458066 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 27/63] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:02:58 2022] GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db => generated 1314 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:02:58.475498 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-4709be6f-5b10-4e31-805c-7e0aac189a5c tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:02:58.477132 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-4709be6f-5b10-4e31-805c-7e0aac189a5c tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: 66d40f73-633e-4564-a6d4-732cd15dcb12] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:02:58.485192 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4709be6f-5b10-4e31-805c-7e0aac189a5c tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:02:58.487368 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4709be6f-5b10-4e31-805c-7e0aac189a5c tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:02:58.490040 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4709be6f-5b10-4e31-805c-7e0aac189a5c tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:02:58.494059 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4709be6f-5b10-4e31-805c-7e0aac189a5c tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:02:58.497548 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4709be6f-5b10-4e31-805c-7e0aac189a5c tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:02:58.498174 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4709be6f-5b10-4e31-805c-7e0aac189a5c tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:02:59.348848 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-4709be6f-5b10-4e31-805c-7e0aac189a5c tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:02:59.363044 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-4709be6f-5b10-4e31-805c-7e0aac189a5c tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12" status: 200 len: 1367 microversion: 2.1 time: 0.901220 Aug 09 07:02:59.363727 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 28/64] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:02:58 2022] GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12 => generated 1367 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:02:59.375868 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-7325f806-5ecb-4b7a-af54-c1e10eaca69a tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:02:59.376926 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-4f6f3eee-3db4-47e4-98d6-bf1f418073df tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Flavor limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 07:02:59.377428 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-4f6f3eee-3db4-47e4-98d6-bf1f418073df tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Image limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 07:02:59.377804 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-4f6f3eee-3db4-47e4-98d6-bf1f418073df tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Flavor pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 07:02:59.378355 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-4f6f3eee-3db4-47e4-98d6-bf1f418073df tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Image pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 07:02:59.378765 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-4f6f3eee-3db4-47e4-98d6-bf1f418073df tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 07:02:59.384687 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-7325f806-5ecb-4b7a-af54-c1e10eaca69a tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:02:59.389757 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4f6f3eee-3db4-47e4-98d6-bf1f418073df tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:02:59.390348 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4f6f3eee-3db4-47e4-98d6-bf1f418073df tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:02:59.391009 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4f6f3eee-3db4-47e4-98d6-bf1f418073df tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:02:59.392010 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4f6f3eee-3db4-47e4-98d6-bf1f418073df tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:02:59.393041 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4f6f3eee-3db4-47e4-98d6-bf1f418073df tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:02:59.393951 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4f6f3eee-3db4-47e4-98d6-bf1f418073df tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:02:59.404346 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7325f806-5ecb-4b7a-af54-c1e10eaca69a tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:02:59.404546 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7325f806-5ecb-4b7a-af54-c1e10eaca69a tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:02:59.404885 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7325f806-5ecb-4b7a-af54-c1e10eaca69a tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:02:59.409916 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7325f806-5ecb-4b7a-af54-c1e10eaca69a tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:02:59.410458 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7325f806-5ecb-4b7a-af54-c1e10eaca69a tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:02:59.410907 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7325f806-5ecb-4b7a-af54-c1e10eaca69a tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:02:59.415907 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-4f6f3eee-3db4-47e4-98d6-bf1f418073df tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Getting quotas for project 10c7e20a9669439fa43853dab6f9851c. Resources: {'cores', 'instances', 'ram'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 07:02:59.422807 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-4f6f3eee-3db4-47e4-98d6-bf1f418073df tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Getting quotas for user 0bb72c5f52fc498aa60eecba3bd5248a and project 10c7e20a9669439fa43853dab6f9851c. Resources: {'cores', 'instances', 'ram'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 07:02:59.436534 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4f6f3eee-3db4-47e4-98d6-bf1f418073df tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Going to run 1 instances... {{(pid=117859) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 07:02:59.439645 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4f6f3eee-3db4-47e4-98d6-bf1f418073df tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5d2c35cc-2f3b-4a22-bd68-79c71882b6a2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 07:02:59.511770 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4f6f3eee-3db4-47e4-98d6-bf1f418073df tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.408005 Aug 09 07:02:59.516520 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 37/65] 10.222.0.30 () {62 vars in 1188 bytes} [Tue Aug 9 07:02:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 2414 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 09 07:02:59.523824 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-ff41a1ae-8ef9-4a0c-a235-19f7396e0974 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:02:59.525345 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-ff41a1ae-8ef9-4a0c-a235-19f7396e0974 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:02:59.534335 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ff41a1ae-8ef9-4a0c-a235-19f7396e0974 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:02:59.535271 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ff41a1ae-8ef9-4a0c-a235-19f7396e0974 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:02:59.535920 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ff41a1ae-8ef9-4a0c-a235-19f7396e0974 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:02:59.536758 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ff41a1ae-8ef9-4a0c-a235-19f7396e0974 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:02:59.537407 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ff41a1ae-8ef9-4a0c-a235-19f7396e0974 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:02:59.538030 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ff41a1ae-8ef9-4a0c-a235-19f7396e0974 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:02:59.566026 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-7325f806-5ecb-4b7a-af54-c1e10eaca69a tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:02:59.577872 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-7325f806-5ecb-4b7a-af54-c1e10eaca69a tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 200 len: 1279 microversion: 2.1 time: 0.211768 Aug 09 07:02:59.578468 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 29/66] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:02:59 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 1279 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:02:59.636328 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ff41a1ae-8ef9-4a0c-a235-19f7396e0974 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:02:59.650435 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-ff41a1ae-8ef9-4a0c-a235-19f7396e0974 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1233 microversion: 2.1 time: 0.132406 Aug 09 07:02:59.654227 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 38/67] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:02:59 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1233 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:02:59.661439 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-304d5792-65fa-479e-b6d5-110bb2686460 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:02:59.662053 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-304d5792-65fa-479e-b6d5-110bb2686460 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] [instance: 9883f029-68a3-4946-b14b-47721b72f3db] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:02:59.682615 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-304d5792-65fa-479e-b6d5-110bb2686460 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:02:59.683796 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-304d5792-65fa-479e-b6d5-110bb2686460 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:02:59.685544 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-304d5792-65fa-479e-b6d5-110bb2686460 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:02:59.687029 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-304d5792-65fa-479e-b6d5-110bb2686460 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:02:59.688774 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-304d5792-65fa-479e-b6d5-110bb2686460 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:02:59.689350 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-304d5792-65fa-479e-b6d5-110bb2686460 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:02:59.954196 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-304d5792-65fa-479e-b6d5-110bb2686460 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef078fe46d418c95f35e1f0bdd2f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8f338b40e4d7e9a6249084bcdaa73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:02:59.968511 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-304d5792-65fa-479e-b6d5-110bb2686460 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] 10.222.0.30 "GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db" status: 200 len: 1314 microversion: 2.1 time: 0.309855 Aug 09 07:02:59.969145 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 39/68] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:02:59 2022] GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db => generated 1314 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:02:59.989915 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c299d5d3-e922-49ca-9665-a03cb3355112 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:02:59.990540 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c299d5d3-e922-49ca-9665-a03cb3355112 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:00.056042 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [req-30bba87b-843e-45c8-8535-efe228358124 req-2d7fdf32-950e-4890-9b43-47f07f9d7d53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66d40f73-633e-4564-a6d4-732cd15dcb12", "tag": "6a17b65c-bc72-41ab-af44-8de8ed744b45"}]} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:03:00.106328 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-30bba87b-843e-45c8-8535-efe228358124 req-2d7fdf32-950e-4890-9b43-47f07f9d7d53 service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:00.110626 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c299d5d3-e922-49ca-9665-a03cb3355112 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:00.111230 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-30bba87b-843e-45c8-8535-efe228358124 req-2d7fdf32-950e-4890-9b43-47f07f9d7d53 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:00.111926 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-30bba87b-843e-45c8-8535-efe228358124 req-2d7fdf32-950e-4890-9b43-47f07f9d7d53 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:00.119237 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c299d5d3-e922-49ca-9665-a03cb3355112 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:00.120947 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c299d5d3-e922-49ca-9665-a03cb3355112 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:00.122058 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c299d5d3-e922-49ca-9665-a03cb3355112 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1281 microversion: 2.20 time: 0.151971 Aug 09 07:03:00.122687 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 40/69] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:02:59 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1281 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:03:00.152382 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.compute.server_external_events [req-30bba87b-843e-45c8-8535-efe228358124 req-2d7fdf32-950e-4890-9b43-47f07f9d7d53 service nova] Creating event network-changed:6a17b65c-bc72-41ab-af44-8de8ed744b45 for instance 66d40f73-633e-4564-a6d4-732cd15dcb12 on hv-cinder-85251 Aug 09 07:03:00.159757 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [req-30bba87b-843e-45c8-8535-efe228358124 req-2d7fdf32-950e-4890-9b43-47f07f9d7d53 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.579523 Aug 09 07:03:00.161567 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 30/70] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:03:00.384218 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-09efae95-d527-45ef-8b4d-80c08a321d14 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:00.385037 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-09efae95-d527-45ef-8b4d-80c08a321d14 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: 66d40f73-633e-4564-a6d4-732cd15dcb12] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:00.391880 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-09efae95-d527-45ef-8b4d-80c08a321d14 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:00.392371 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-09efae95-d527-45ef-8b4d-80c08a321d14 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:00.392831 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-09efae95-d527-45ef-8b4d-80c08a321d14 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:00.393528 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-09efae95-d527-45ef-8b4d-80c08a321d14 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:00.393978 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-09efae95-d527-45ef-8b4d-80c08a321d14 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:00.394410 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-09efae95-d527-45ef-8b4d-80c08a321d14 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:00.608829 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-a75d1cb7-c475-4619-b38c-7034ea94fd46 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:00.613018 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-a75d1cb7-c475-4619-b38c-7034ea94fd46 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:00.631492 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a75d1cb7-c475-4619-b38c-7034ea94fd46 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:00.632148 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a75d1cb7-c475-4619-b38c-7034ea94fd46 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:00.632764 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a75d1cb7-c475-4619-b38c-7034ea94fd46 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:00.634337 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a75d1cb7-c475-4619-b38c-7034ea94fd46 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:00.637896 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a75d1cb7-c475-4619-b38c-7034ea94fd46 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:00.641388 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a75d1cb7-c475-4619-b38c-7034ea94fd46 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:00.747317 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-09efae95-d527-45ef-8b4d-80c08a321d14 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:00.756593 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-09efae95-d527-45ef-8b4d-80c08a321d14 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12" status: 200 len: 1367 microversion: 2.1 time: 0.376163 Aug 09 07:03:00.769138 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 41/71] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:00 2022] GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12 => generated 1367 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:00.785791 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e189450c-6dcf-4e38-ad70-f0d1122e89a7 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:00.807172 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-e189450c-6dcf-4e38-ad70-f0d1122e89a7 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:00.829548 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e189450c-6dcf-4e38-ad70-f0d1122e89a7 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:00.830366 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e189450c-6dcf-4e38-ad70-f0d1122e89a7 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:00.830888 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e189450c-6dcf-4e38-ad70-f0d1122e89a7 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:00.831877 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e189450c-6dcf-4e38-ad70-f0d1122e89a7 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:00.834326 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e189450c-6dcf-4e38-ad70-f0d1122e89a7 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:00.835295 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e189450c-6dcf-4e38-ad70-f0d1122e89a7 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:00.858496 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-a75d1cb7-c475-4619-b38c-7034ea94fd46 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:00.881325 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-a75d1cb7-c475-4619-b38c-7034ea94fd46 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 200 len: 1279 microversion: 2.1 time: 0.279897 Aug 09 07:03:00.886758 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 31/72] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:00 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 1279 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:03:01.013006 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-88ed9cc1-5001-44d7-9c81-0812be0d07aa tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:01.014272 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-88ed9cc1-5001-44d7-9c81-0812be0d07aa tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] [instance: 9883f029-68a3-4946-b14b-47721b72f3db] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:01.036100 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-88ed9cc1-5001-44d7-9c81-0812be0d07aa tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:01.043483 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-88ed9cc1-5001-44d7-9c81-0812be0d07aa tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:01.045843 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-88ed9cc1-5001-44d7-9c81-0812be0d07aa tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:01.048742 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-88ed9cc1-5001-44d7-9c81-0812be0d07aa tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:01.056973 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-88ed9cc1-5001-44d7-9c81-0812be0d07aa tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:01.057953 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-88ed9cc1-5001-44d7-9c81-0812be0d07aa tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:01.560180 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e189450c-6dcf-4e38-ad70-f0d1122e89a7 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:01.593423 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-e189450c-6dcf-4e38-ad70-f0d1122e89a7 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1233 microversion: 2.1 time: 0.822860 Aug 09 07:03:01.594880 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 42/73] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:00 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1233 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:01.615494 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4a8d73d7-60db-4e5f-a37e-ea606bed2642 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:01.620327 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4a8d73d7-60db-4e5f-a37e-ea606bed2642 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:01.625150 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:01.674268 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4a8d73d7-60db-4e5f-a37e-ea606bed2642 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:01.674850 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4a8d73d7-60db-4e5f-a37e-ea606bed2642 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:01.675306 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4a8d73d7-60db-4e5f-a37e-ea606bed2642 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:01.676143 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4a8d73d7-60db-4e5f-a37e-ea606bed2642 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:01.676551 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4a8d73d7-60db-4e5f-a37e-ea606bed2642 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:01.676976 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4a8d73d7-60db-4e5f-a37e-ea606bed2642 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:02.167323 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-88ed9cc1-5001-44d7-9c81-0812be0d07aa tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef078fe46d418c95f35e1f0bdd2f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8f338b40e4d7e9a6249084bcdaa73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:02.174901 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4a8d73d7-60db-4e5f-a37e-ea606bed2642 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:02.193826 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-88ed9cc1-5001-44d7-9c81-0812be0d07aa tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] 10.222.0.30 "GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db" status: 200 len: 1314 microversion: 2.1 time: 1.203799 Aug 09 07:03:02.200497 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4a8d73d7-60db-4e5f-a37e-ea606bed2642 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:02.203446 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 32/74] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:00 2022] GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db => generated 1314 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:02.206912 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4a8d73d7-60db-4e5f-a37e-ea606bed2642 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:02.214632 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4a8d73d7-60db-4e5f-a37e-ea606bed2642 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1333 microversion: 2.20 time: 0.607108 Aug 09 07:03:02.215543 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 43/75] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:03:01 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1333 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:03:02.227986 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-040547b7-4df3-4e41-950d-5ce0fa24e7c5 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:02.234093 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-040547b7-4df3-4e41-950d-5ce0fa24e7c5 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: 66d40f73-633e-4564-a6d4-732cd15dcb12] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:02.246924 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-715596fb-1af7-46b3-967e-fc712e90c314 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:02.250365 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-715596fb-1af7-46b3-967e-fc712e90c314 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:02.263020 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-040547b7-4df3-4e41-950d-5ce0fa24e7c5 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:02.267505 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-040547b7-4df3-4e41-950d-5ce0fa24e7c5 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:02.272306 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-040547b7-4df3-4e41-950d-5ce0fa24e7c5 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:02.278136 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-040547b7-4df3-4e41-950d-5ce0fa24e7c5 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:02.280131 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-040547b7-4df3-4e41-950d-5ce0fa24e7c5 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:02.282547 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-040547b7-4df3-4e41-950d-5ce0fa24e7c5 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:02.290499 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-715596fb-1af7-46b3-967e-fc712e90c314 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:02.296235 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-715596fb-1af7-46b3-967e-fc712e90c314 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:02.297312 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-715596fb-1af7-46b3-967e-fc712e90c314 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:02.302488 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-715596fb-1af7-46b3-967e-fc712e90c314 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:02.308089 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-715596fb-1af7-46b3-967e-fc712e90c314 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:02.312369 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-715596fb-1af7-46b3-967e-fc712e90c314 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:02.987970 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-715596fb-1af7-46b3-967e-fc712e90c314 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:03.000753 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-715596fb-1af7-46b3-967e-fc712e90c314 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 200 len: 1279 microversion: 2.1 time: 0.775161 Aug 09 07:03:03.004585 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 44/76] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:02 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 1279 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:03.033760 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a2831f39-06e9-4e20-ab3b-10dadbdde52c tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:03.034408 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-a2831f39-06e9-4e20-ab3b-10dadbdde52c tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:03.051308 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a2831f39-06e9-4e20-ab3b-10dadbdde52c tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:03.051951 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a2831f39-06e9-4e20-ab3b-10dadbdde52c tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:03.052458 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a2831f39-06e9-4e20-ab3b-10dadbdde52c tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:03.060480 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a2831f39-06e9-4e20-ab3b-10dadbdde52c tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:03.061201 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a2831f39-06e9-4e20-ab3b-10dadbdde52c tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:03.061838 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a2831f39-06e9-4e20-ab3b-10dadbdde52c tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:03.314130 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-a2831f39-06e9-4e20-ab3b-10dadbdde52c tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:03.324241 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-a2831f39-06e9-4e20-ab3b-10dadbdde52c tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1297 microversion: 2.1 time: 0.301425 Aug 09 07:03:03.328548 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-040547b7-4df3-4e41-950d-5ce0fa24e7c5 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:03.330530 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 45/77] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:03 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1297 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:03.346682 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-9617b74e-13e1-463d-80ef-422bffd8ea7d tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:03.348095 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-9617b74e-13e1-463d-80ef-422bffd8ea7d tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] [instance: 9883f029-68a3-4946-b14b-47721b72f3db] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:03.350319 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-040547b7-4df3-4e41-950d-5ce0fa24e7c5 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12" status: 200 len: 1367 microversion: 2.1 time: 1.145302 Aug 09 07:03:03.351784 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 33/78] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:02 2022] GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12 => generated 1367 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:03.357144 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-743ff2ac-1a3a-455f-9e43-896eca35cf94 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:03.357758 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-743ff2ac-1a3a-455f-9e43-896eca35cf94 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:03.358851 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9617b74e-13e1-463d-80ef-422bffd8ea7d tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:03.359771 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9617b74e-13e1-463d-80ef-422bffd8ea7d tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:03.360597 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9617b74e-13e1-463d-80ef-422bffd8ea7d tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:03.365195 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-743ff2ac-1a3a-455f-9e43-896eca35cf94 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:03.369093 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9617b74e-13e1-463d-80ef-422bffd8ea7d tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:03.370981 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9617b74e-13e1-463d-80ef-422bffd8ea7d tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:03.372237 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9617b74e-13e1-463d-80ef-422bffd8ea7d tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:03.380848 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-743ff2ac-1a3a-455f-9e43-896eca35cf94 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:03.381728 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-743ff2ac-1a3a-455f-9e43-896eca35cf94 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:03.382698 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-743ff2ac-1a3a-455f-9e43-896eca35cf94 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:03.385249 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-743ff2ac-1a3a-455f-9e43-896eca35cf94 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:03.385925 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-743ff2ac-1a3a-455f-9e43-896eca35cf94 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:03.503859 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-743ff2ac-1a3a-455f-9e43-896eca35cf94 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:03.520903 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-743ff2ac-1a3a-455f-9e43-896eca35cf94 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:03.525700 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-743ff2ac-1a3a-455f-9e43-896eca35cf94 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:03.530302 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-743ff2ac-1a3a-455f-9e43-896eca35cf94 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1333 microversion: 2.20 time: 0.174856 Aug 09 07:03:03.546636 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 34/79] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:03:03 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1333 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:03:04.030328 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-4be1b444-ab8b-4afc-a5b6-0751904e6a84 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:04.031681 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-4be1b444-ab8b-4afc-a5b6-0751904e6a84 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:04.041992 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_cell0:SELECT=30 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:04.046250 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4be1b444-ab8b-4afc-a5b6-0751904e6a84 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:04.046791 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4be1b444-ab8b-4afc-a5b6-0751904e6a84 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:04.047230 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4be1b444-ab8b-4afc-a5b6-0751904e6a84 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:04.054307 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4be1b444-ab8b-4afc-a5b6-0751904e6a84 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:04.057914 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4be1b444-ab8b-4afc-a5b6-0751904e6a84 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:04.061912 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4be1b444-ab8b-4afc-a5b6-0751904e6a84 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:04.407061 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-9617b74e-13e1-463d-80ef-422bffd8ea7d tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef078fe46d418c95f35e1f0bdd2f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8f338b40e4d7e9a6249084bcdaa73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:04.418596 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-9617b74e-13e1-463d-80ef-422bffd8ea7d tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] 10.222.0.30 "GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db" status: 200 len: 1314 microversion: 2.1 time: 1.086745 Aug 09 07:03:04.419180 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 46/80] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:03 2022] GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db => generated 1314 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:04.427021 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4b00c4ad-2350-472d-a71e-6e665e13fae0 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:04.433580 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4b00c4ad-2350-472d-a71e-6e665e13fae0 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:04.444361 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4b00c4ad-2350-472d-a71e-6e665e13fae0 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:04.444852 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4b00c4ad-2350-472d-a71e-6e665e13fae0 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:04.445288 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4b00c4ad-2350-472d-a71e-6e665e13fae0 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:04.446552 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4b00c4ad-2350-472d-a71e-6e665e13fae0 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:04.447215 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4b00c4ad-2350-472d-a71e-6e665e13fae0 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:04.447692 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4b00c4ad-2350-472d-a71e-6e665e13fae0 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:04.574742 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-4be1b444-ab8b-4afc-a5b6-0751904e6a84 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:04.581705 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_cell1:SELECT=85 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:04.591707 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-4be1b444-ab8b-4afc-a5b6-0751904e6a84 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 200 len: 1321 microversion: 2.1 time: 0.564682 Aug 09 07:03:04.592588 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 35/81] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:04 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 1321 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:04.596567 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4b00c4ad-2350-472d-a71e-6e665e13fae0 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:04.604497 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=100 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:04.615285 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-499a3460-fdc3-46a6-997b-e93294fab311 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:04.621935 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4b00c4ad-2350-472d-a71e-6e665e13fae0 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1295 microversion: 2.1 time: 0.195813 Aug 09 07:03:04.623090 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 47/82] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:04 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1295 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:04.628549 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-499a3460-fdc3-46a6-997b-e93294fab311 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: 66d40f73-633e-4564-a6d4-732cd15dcb12] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:04.637445 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-8977da25-96fd-4f88-b64f-b20fc6be3f74 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:04.642005 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-8977da25-96fd-4f88-b64f-b20fc6be3f74 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:04.651902 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-499a3460-fdc3-46a6-997b-e93294fab311 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:04.652448 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-499a3460-fdc3-46a6-997b-e93294fab311 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:04.652901 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-499a3460-fdc3-46a6-997b-e93294fab311 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:04.653635 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-499a3460-fdc3-46a6-997b-e93294fab311 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:04.654097 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-499a3460-fdc3-46a6-997b-e93294fab311 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:04.660170 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-499a3460-fdc3-46a6-997b-e93294fab311 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:04.665358 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8977da25-96fd-4f88-b64f-b20fc6be3f74 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:04.665934 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8977da25-96fd-4f88-b64f-b20fc6be3f74 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:04.666387 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8977da25-96fd-4f88-b64f-b20fc6be3f74 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:04.667126 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8977da25-96fd-4f88-b64f-b20fc6be3f74 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:04.673889 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8977da25-96fd-4f88-b64f-b20fc6be3f74 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:04.674668 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8977da25-96fd-4f88-b64f-b20fc6be3f74 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:04.817515 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8977da25-96fd-4f88-b64f-b20fc6be3f74 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:04.827730 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8977da25-96fd-4f88-b64f-b20fc6be3f74 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:04.829764 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8977da25-96fd-4f88-b64f-b20fc6be3f74 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:04.831018 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-8977da25-96fd-4f88-b64f-b20fc6be3f74 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1339 microversion: 2.20 time: 0.206531 Aug 09 07:03:04.832065 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 48/83] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:03:04 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1339 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:03:05.156077 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-499a3460-fdc3-46a6-997b-e93294fab311 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:05.165991 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-499a3460-fdc3-46a6-997b-e93294fab311 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12" status: 200 len: 1367 microversion: 2.1 time: 0.558916 Aug 09 07:03:05.167049 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 36/84] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:04 2022] GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12 => generated 1367 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:05.400248 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-42a440d0-155a-4198-a65b-d20b6713a7e8 req-7e3afe2a-4ee1-4c26-a59b-ee9f6fb3f9c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fe62967-63ba-4d67-88c4-25e1c1d445fa", "tag": "c3f302ed-7425-4dd7-9fc2-33ba9fdf4954"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:03:05.406694 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [req-d7f1f34a-383c-42b3-a669-fe4eee916f86 req-249fedaa-c63d-4ef2-9c67-4fc817948750 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64c9caf8-5201-418c-ba08-9bc9f5a55f57", "tag": "4d513942-ac8d-433b-899e-8512feefa9a7"}]} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:03:05.412581 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-42a440d0-155a-4198-a65b-d20b6713a7e8 req-7e3afe2a-4ee1-4c26-a59b-ee9f6fb3f9c6 service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:05.413617 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-42a440d0-155a-4198-a65b-d20b6713a7e8 req-7e3afe2a-4ee1-4c26-a59b-ee9f6fb3f9c6 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:05.414217 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-42a440d0-155a-4198-a65b-d20b6713a7e8 req-7e3afe2a-4ee1-4c26-a59b-ee9f6fb3f9c6 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:05.418147 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-d7f1f34a-383c-42b3-a669-fe4eee916f86 req-249fedaa-c63d-4ef2-9c67-4fc817948750 service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:05.418740 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-d7f1f34a-383c-42b3-a669-fe4eee916f86 req-249fedaa-c63d-4ef2-9c67-4fc817948750 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:05.419291 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-d7f1f34a-383c-42b3-a669-fe4eee916f86 req-249fedaa-c63d-4ef2-9c67-4fc817948750 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:05.435073 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-42a440d0-155a-4198-a65b-d20b6713a7e8 req-7e3afe2a-4ee1-4c26-a59b-ee9f6fb3f9c6 service nova] Creating event network-changed:c3f302ed-7425-4dd7-9fc2-33ba9fdf4954 for instance 9fe62967-63ba-4d67-88c4-25e1c1d445fa on hv-cinder-85251 Aug 09 07:03:05.435976 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-42a440d0-155a-4198-a65b-d20b6713a7e8 req-7e3afe2a-4ee1-4c26-a59b-ee9f6fb3f9c6 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=117859) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 09 07:03:05.436377 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-42a440d0-155a-4198-a65b-d20b6713a7e8 req-7e3afe2a-4ee1-4c26-a59b-ee9f6fb3f9c6 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117859) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 09 07:03:05.437361 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.compute.server_external_events [req-d7f1f34a-383c-42b3-a669-fe4eee916f86 req-249fedaa-c63d-4ef2-9c67-4fc817948750 service nova] Creating event network-changed:4d513942-ac8d-433b-899e-8512feefa9a7 for instance 64c9caf8-5201-418c-ba08-9bc9f5a55f57 on hv-cinder-85251 Aug 09 07:03:05.437476 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4b2a6dd7-14fe-4b39-ac36-bda0f4dec16a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:05.437855 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4b2a6dd7-14fe-4b39-ac36-bda0f4dec16a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:05.438294 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4b2a6dd7-14fe-4b39-ac36-bda0f4dec16a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:05.439007 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4b2a6dd7-14fe-4b39-ac36-bda0f4dec16a None None] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:05.439651 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4b2a6dd7-14fe-4b39-ac36-bda0f4dec16a None None] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:05.440230 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4b2a6dd7-14fe-4b39-ac36-bda0f4dec16a None None] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:05.442888 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [req-d7f1f34a-383c-42b3-a669-fe4eee916f86 req-249fedaa-c63d-4ef2-9c67-4fc817948750 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040119 Aug 09 07:03:05.443956 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 37/85] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:03:05.449979 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-876cdb2b-6b3e-4380-a117-1419e9909cf0 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:05.450767 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-876cdb2b-6b3e-4380-a117-1419e9909cf0 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] [instance: 9883f029-68a3-4946-b14b-47721b72f3db] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:05.451371 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.compute.rpcapi [None req-4b2a6dd7-14fe-4b39-ac36-bda0f4dec16a None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 09 07:03:05.452462 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4b2a6dd7-14fe-4b39-ac36-bda0f4dec16a None None] Releasing lock "compute-rpcapi-router" {{(pid=117859) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 09 07:03:05.458016 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-876cdb2b-6b3e-4380-a117-1419e9909cf0 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:05.458581 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-876cdb2b-6b3e-4380-a117-1419e9909cf0 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:05.459120 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-876cdb2b-6b3e-4380-a117-1419e9909cf0 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:05.460019 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-876cdb2b-6b3e-4380-a117-1419e9909cf0 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:05.460650 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-876cdb2b-6b3e-4380-a117-1419e9909cf0 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:05.461138 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-876cdb2b-6b3e-4380-a117-1419e9909cf0 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:05.476312 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4b2a6dd7-14fe-4b39-ac36-bda0f4dec16a None None] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079994 Aug 09 07:03:05.478064 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 49/86] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:03:05.621322 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f92a3082-ac80-4641-b715-6642f83a4b72 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:05.621996 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-f92a3082-ac80-4641-b715-6642f83a4b72 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:05.628857 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f92a3082-ac80-4641-b715-6642f83a4b72 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:05.629764 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f92a3082-ac80-4641-b715-6642f83a4b72 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:05.630268 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f92a3082-ac80-4641-b715-6642f83a4b72 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:05.631051 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f92a3082-ac80-4641-b715-6642f83a4b72 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:05.631740 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f92a3082-ac80-4641-b715-6642f83a4b72 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:05.632236 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f92a3082-ac80-4641-b715-6642f83a4b72 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:05.913530 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-876cdb2b-6b3e-4380-a117-1419e9909cf0 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef078fe46d418c95f35e1f0bdd2f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8f338b40e4d7e9a6249084bcdaa73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:05.932845 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-876cdb2b-6b3e-4380-a117-1419e9909cf0 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] 10.222.0.30 "GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db" status: 200 len: 1314 microversion: 2.1 time: 0.487550 Aug 09 07:03:05.946734 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 38/87] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:05 2022] GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db => generated 1314 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:05.946734 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-2893a385-da1f-488c-b132-63975705fd64 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:05.946734 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-2893a385-da1f-488c-b132-63975705fd64 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:05.956585 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2893a385-da1f-488c-b132-63975705fd64 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:05.957059 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2893a385-da1f-488c-b132-63975705fd64 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:05.959817 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2893a385-da1f-488c-b132-63975705fd64 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:05.959817 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2893a385-da1f-488c-b132-63975705fd64 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:05.959817 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2893a385-da1f-488c-b132-63975705fd64 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:05.959817 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2893a385-da1f-488c-b132-63975705fd64 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:06.144814 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-2893a385-da1f-488c-b132-63975705fd64 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:06.154922 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-2893a385-da1f-488c-b132-63975705fd64 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1295 microversion: 2.1 time: 0.219995 Aug 09 07:03:06.169155 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 39/88] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:05 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1295 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:06.186959 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-c4509ae2-0a50-4cd2-90fd-e37f0dce2f02 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:06.187940 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-c4509ae2-0a50-4cd2-90fd-e37f0dce2f02 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:06.197633 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c4509ae2-0a50-4cd2-90fd-e37f0dce2f02 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:06.198315 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c4509ae2-0a50-4cd2-90fd-e37f0dce2f02 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:06.198901 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c4509ae2-0a50-4cd2-90fd-e37f0dce2f02 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:06.199801 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c4509ae2-0a50-4cd2-90fd-e37f0dce2f02 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:06.200598 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c4509ae2-0a50-4cd2-90fd-e37f0dce2f02 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:06.201464 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c4509ae2-0a50-4cd2-90fd-e37f0dce2f02 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:06.206664 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-f92a3082-ac80-4641-b715-6642f83a4b72 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:06.218575 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f92a3082-ac80-4641-b715-6642f83a4b72 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 200 len: 1321 microversion: 2.1 time: 0.602690 Aug 09 07:03:06.220935 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 50/89] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:05 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 1321 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:03:06.241341 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-28d1a9a3-e7cd-413f-a476-b2e0ac11ee0a tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:06.242478 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-28d1a9a3-e7cd-413f-a476-b2e0ac11ee0a tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: 66d40f73-633e-4564-a6d4-732cd15dcb12] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:06.272235 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-28d1a9a3-e7cd-413f-a476-b2e0ac11ee0a tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:06.273859 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-28d1a9a3-e7cd-413f-a476-b2e0ac11ee0a tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:06.276789 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-28d1a9a3-e7cd-413f-a476-b2e0ac11ee0a tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:06.277656 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-28d1a9a3-e7cd-413f-a476-b2e0ac11ee0a tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:06.278511 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-28d1a9a3-e7cd-413f-a476-b2e0ac11ee0a tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:06.279289 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-28d1a9a3-e7cd-413f-a476-b2e0ac11ee0a tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:06.375362 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-c4509ae2-0a50-4cd2-90fd-e37f0dce2f02 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:06.390116 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-c4509ae2-0a50-4cd2-90fd-e37f0dce2f02 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:06.392507 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-c4509ae2-0a50-4cd2-90fd-e37f0dce2f02 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:06.394040 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-c4509ae2-0a50-4cd2-90fd-e37f0dce2f02 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1339 microversion: 2.20 time: 0.214922 Aug 09 07:03:06.394838 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 40/90] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:03:06 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1339 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:03:06.768356 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-28d1a9a3-e7cd-413f-a476-b2e0ac11ee0a tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:06.784831 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-28d1a9a3-e7cd-413f-a476-b2e0ac11ee0a tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12" status: 200 len: 1367 microversion: 2.1 time: 0.561511 Aug 09 07:03:06.785451 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 51/91] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:06 2022] GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12 => generated 1367 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:06.954396 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-0f8366ba-17dc-43e0-b641-0ed0f71d11e2 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:06.955089 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-0f8366ba-17dc-43e0-b641-0ed0f71d11e2 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] [instance: 9883f029-68a3-4946-b14b-47721b72f3db] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:06.963485 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0f8366ba-17dc-43e0-b641-0ed0f71d11e2 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:06.964056 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0f8366ba-17dc-43e0-b641-0ed0f71d11e2 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:06.964590 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0f8366ba-17dc-43e0-b641-0ed0f71d11e2 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:06.965407 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0f8366ba-17dc-43e0-b641-0ed0f71d11e2 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:06.966058 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0f8366ba-17dc-43e0-b641-0ed0f71d11e2 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:06.966729 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0f8366ba-17dc-43e0-b641-0ed0f71d11e2 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:07.189193 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b1fc8a5f-c524-4eec-81c2-bddb766a9a00 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:07.189193 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b1fc8a5f-c524-4eec-81c2-bddb766a9a00 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:07.193229 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b1fc8a5f-c524-4eec-81c2-bddb766a9a00 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:07.193826 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b1fc8a5f-c524-4eec-81c2-bddb766a9a00 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:07.194485 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b1fc8a5f-c524-4eec-81c2-bddb766a9a00 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:07.195292 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b1fc8a5f-c524-4eec-81c2-bddb766a9a00 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:07.195924 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b1fc8a5f-c524-4eec-81c2-bddb766a9a00 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:07.196474 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b1fc8a5f-c524-4eec-81c2-bddb766a9a00 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:07.297472 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-0f8366ba-17dc-43e0-b641-0ed0f71d11e2 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef078fe46d418c95f35e1f0bdd2f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8f338b40e4d7e9a6249084bcdaa73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:07.305435 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-0f8366ba-17dc-43e0-b641-0ed0f71d11e2 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] 10.222.0.30 "GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db" status: 200 len: 1314 microversion: 2.1 time: 0.354758 Aug 09 07:03:07.306368 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 41/92] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:06 2022] GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db => generated 1314 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:07.311746 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-40be1f2a-d7f4-4669-ab28-c739345b16e6 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:07.313391 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-40be1f2a-d7f4-4669-ab28-c739345b16e6 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:07.319949 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-40be1f2a-d7f4-4669-ab28-c739345b16e6 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:07.320675 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-40be1f2a-d7f4-4669-ab28-c739345b16e6 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:07.322023 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-40be1f2a-d7f4-4669-ab28-c739345b16e6 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:07.323390 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-40be1f2a-d7f4-4669-ab28-c739345b16e6 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:07.324371 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-40be1f2a-d7f4-4669-ab28-c739345b16e6 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:07.325003 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-40be1f2a-d7f4-4669-ab28-c739345b16e6 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:07.333036 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b1fc8a5f-c524-4eec-81c2-bddb766a9a00 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:07.350198 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b1fc8a5f-c524-4eec-81c2-bddb766a9a00 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1295 microversion: 2.1 time: 0.167510 Aug 09 07:03:07.362823 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 52/93] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:07 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1295 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:07.428664 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b1917832-465e-44ee-b20f-60ec899aab1e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:07.429516 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b1917832-465e-44ee-b20f-60ec899aab1e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:07.440086 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b1917832-465e-44ee-b20f-60ec899aab1e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:07.440574 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b1917832-465e-44ee-b20f-60ec899aab1e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:07.441006 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b1917832-465e-44ee-b20f-60ec899aab1e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:07.441701 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b1917832-465e-44ee-b20f-60ec899aab1e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:07.442149 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b1917832-465e-44ee-b20f-60ec899aab1e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:07.442564 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b1917832-465e-44ee-b20f-60ec899aab1e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:07.530720 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b1917832-465e-44ee-b20f-60ec899aab1e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:07.546148 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b1917832-465e-44ee-b20f-60ec899aab1e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:07.549160 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b1917832-465e-44ee-b20f-60ec899aab1e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:07.550332 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b1917832-465e-44ee-b20f-60ec899aab1e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1339 microversion: 2.20 time: 0.125903 Aug 09 07:03:07.551097 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 53/94] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:03:07 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1339 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:03:07.582230 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-40be1f2a-d7f4-4669-ab28-c739345b16e6 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:07.592347 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-40be1f2a-d7f4-4669-ab28-c739345b16e6 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 200 len: 1321 microversion: 2.1 time: 0.284718 Aug 09 07:03:07.596604 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 42/95] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:07 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 1321 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:07.813507 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-520cfd52-5091-493c-a4ce-c084068a0499 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:07.815240 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-520cfd52-5091-493c-a4ce-c084068a0499 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: 66d40f73-633e-4564-a6d4-732cd15dcb12] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:07.825380 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-520cfd52-5091-493c-a4ce-c084068a0499 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:07.825982 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-520cfd52-5091-493c-a4ce-c084068a0499 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:07.826493 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-520cfd52-5091-493c-a4ce-c084068a0499 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:07.827292 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-520cfd52-5091-493c-a4ce-c084068a0499 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:07.828601 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-520cfd52-5091-493c-a4ce-c084068a0499 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:07.828861 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-520cfd52-5091-493c-a4ce-c084068a0499 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:08.262159 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-520cfd52-5091-493c-a4ce-c084068a0499 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:08.283445 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-520cfd52-5091-493c-a4ce-c084068a0499 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12" status: 200 len: 1367 microversion: 2.1 time: 0.476117 Aug 09 07:03:08.289132 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 54/96] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:07 2022] GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12 => generated 1367 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:08.338088 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-a03f8c0a-0a03-4881-a590-e67972bcab15 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:08.341201 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-a03f8c0a-0a03-4881-a590-e67972bcab15 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] [instance: 9883f029-68a3-4946-b14b-47721b72f3db] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:08.346286 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_cell0:SELECT=10 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:08.360948 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a03f8c0a-0a03-4881-a590-e67972bcab15 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:08.361438 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a03f8c0a-0a03-4881-a590-e67972bcab15 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:08.362629 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a03f8c0a-0a03-4881-a590-e67972bcab15 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:08.363582 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a03f8c0a-0a03-4881-a590-e67972bcab15 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:08.363836 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a03f8c0a-0a03-4881-a590-e67972bcab15 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:08.364258 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a03f8c0a-0a03-4881-a590-e67972bcab15 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:08.385039 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-5d3ab636-1e86-4e8b-bd88-18aeeb40684b tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:08.385658 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-5d3ab636-1e86-4e8b-bd88-18aeeb40684b tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:08.399937 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5d3ab636-1e86-4e8b-bd88-18aeeb40684b tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:08.408538 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5d3ab636-1e86-4e8b-bd88-18aeeb40684b tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:08.409387 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5d3ab636-1e86-4e8b-bd88-18aeeb40684b tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:08.410379 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5d3ab636-1e86-4e8b-bd88-18aeeb40684b tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:08.411020 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5d3ab636-1e86-4e8b-bd88-18aeeb40684b tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:08.416886 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5d3ab636-1e86-4e8b-bd88-18aeeb40684b tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:08.688118 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-a03f8c0a-0a03-4881-a590-e67972bcab15 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef078fe46d418c95f35e1f0bdd2f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8f338b40e4d7e9a6249084bcdaa73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:08.701063 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-a03f8c0a-0a03-4881-a590-e67972bcab15 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] 10.222.0.30 "GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db" status: 200 len: 1314 microversion: 2.1 time: 0.372347 Aug 09 07:03:08.705202 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 43/97] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:08 2022] GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db => generated 1314 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:08.731253 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-d55573b2-a131-47bc-9ee8-e276cb8745ac tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:08.732255 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-d55573b2-a131-47bc-9ee8-e276cb8745ac tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:08.745039 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d55573b2-a131-47bc-9ee8-e276cb8745ac tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:08.745889 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d55573b2-a131-47bc-9ee8-e276cb8745ac tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:08.746542 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d55573b2-a131-47bc-9ee8-e276cb8745ac tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:08.748922 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d55573b2-a131-47bc-9ee8-e276cb8745ac tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:08.749615 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d55573b2-a131-47bc-9ee8-e276cb8745ac tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:08.750340 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d55573b2-a131-47bc-9ee8-e276cb8745ac tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:08.871697 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-5d3ab636-1e86-4e8b-bd88-18aeeb40684b tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:08.897975 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-5d3ab636-1e86-4e8b-bd88-18aeeb40684b tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1363 microversion: 2.1 time: 0.517007 Aug 09 07:03:08.899939 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 55/98] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:08 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1363 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:08.907510 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-cfa57510-9ab9-4a06-8337-574ade5d8433 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:08.908541 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-cfa57510-9ab9-4a06-8337-574ade5d8433 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:08.926619 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cfa57510-9ab9-4a06-8337-574ade5d8433 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:08.927130 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cfa57510-9ab9-4a06-8337-574ade5d8433 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:08.933393 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cfa57510-9ab9-4a06-8337-574ade5d8433 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:08.934228 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cfa57510-9ab9-4a06-8337-574ade5d8433 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:08.934871 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cfa57510-9ab9-4a06-8337-574ade5d8433 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:08.935450 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cfa57510-9ab9-4a06-8337-574ade5d8433 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:08.957975 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-d55573b2-a131-47bc-9ee8-e276cb8745ac tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:08.968600 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-d55573b2-a131-47bc-9ee8-e276cb8745ac tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:08.970514 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-d55573b2-a131-47bc-9ee8-e276cb8745ac tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:08.971975 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-d55573b2-a131-47bc-9ee8-e276cb8745ac tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1406 microversion: 2.20 time: 0.265411 Aug 09 07:03:08.972844 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 44/99] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:03:08 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1406 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:03:09.132263 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-cfa57510-9ab9-4a06-8337-574ade5d8433 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:09.142709 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-cfa57510-9ab9-4a06-8337-574ade5d8433 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 200 len: 1321 microversion: 2.1 time: 0.241191 Aug 09 07:03:09.143633 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 56/100] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:08 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 1321 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:09.308068 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-d8b2f4b6-8f92-4291-9333-bd50efc6b529 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:09.308904 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-d8b2f4b6-8f92-4291-9333-bd50efc6b529 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: 66d40f73-633e-4564-a6d4-732cd15dcb12] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:09.322671 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d8b2f4b6-8f92-4291-9333-bd50efc6b529 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:09.324207 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d8b2f4b6-8f92-4291-9333-bd50efc6b529 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:09.325390 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d8b2f4b6-8f92-4291-9333-bd50efc6b529 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:09.327498 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d8b2f4b6-8f92-4291-9333-bd50efc6b529 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:09.328779 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d8b2f4b6-8f92-4291-9333-bd50efc6b529 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:09.329221 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d8b2f4b6-8f92-4291-9333-bd50efc6b529 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:09.605448 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-d8b2f4b6-8f92-4291-9333-bd50efc6b529 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:09.616337 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-d8b2f4b6-8f92-4291-9333-bd50efc6b529 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12" status: 200 len: 1367 microversion: 2.1 time: 0.313798 Aug 09 07:03:09.619296 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 45/101] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:09 2022] GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12 => generated 1367 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:09.670895 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-ec4c6ae1-7b23-4f35-83ec-51e3631d9b92 req-d7027280-50eb-4d17-b132-c1457fde9137 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46", "tag": "8ca46829-e122-42ef-87e0-c5d0bd4f1294"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:03:09.691776 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-ec4c6ae1-7b23-4f35-83ec-51e3631d9b92 req-d7027280-50eb-4d17-b132-c1457fde9137 service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:09.692286 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-ec4c6ae1-7b23-4f35-83ec-51e3631d9b92 req-d7027280-50eb-4d17-b132-c1457fde9137 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:09.693189 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-ec4c6ae1-7b23-4f35-83ec-51e3631d9b92 req-d7027280-50eb-4d17-b132-c1457fde9137 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:09.741151 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-90a880f3-81d9-47fb-b2d5-1d0287806a13 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:09.742122 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-90a880f3-81d9-47fb-b2d5-1d0287806a13 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] [instance: 9883f029-68a3-4946-b14b-47721b72f3db] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:09.762594 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-ec4c6ae1-7b23-4f35-83ec-51e3631d9b92 req-d7027280-50eb-4d17-b132-c1457fde9137 service nova] Creating event network-changed:8ca46829-e122-42ef-87e0-c5d0bd4f1294 for instance 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 on hv-cinder-85251 Aug 09 07:03:09.773007 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-90a880f3-81d9-47fb-b2d5-1d0287806a13 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:09.774824 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-90a880f3-81d9-47fb-b2d5-1d0287806a13 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:09.775666 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-90a880f3-81d9-47fb-b2d5-1d0287806a13 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:09.776485 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-ec4c6ae1-7b23-4f35-83ec-51e3631d9b92 req-d7027280-50eb-4d17-b132-c1457fde9137 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108151 Aug 09 07:03:09.778260 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 57/102] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:03:09.779101 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-90a880f3-81d9-47fb-b2d5-1d0287806a13 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:09.779798 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-90a880f3-81d9-47fb-b2d5-1d0287806a13 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:09.782757 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-90a880f3-81d9-47fb-b2d5-1d0287806a13 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:09.923107 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-9f34486d-ab18-4713-815a-8bcac182a8f6 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:09.930715 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-9f34486d-ab18-4713-815a-8bcac182a8f6 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:09.938649 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9f34486d-ab18-4713-815a-8bcac182a8f6 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:09.939219 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9f34486d-ab18-4713-815a-8bcac182a8f6 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:09.939569 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9f34486d-ab18-4713-815a-8bcac182a8f6 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:09.942958 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9f34486d-ab18-4713-815a-8bcac182a8f6 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:09.943484 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9f34486d-ab18-4713-815a-8bcac182a8f6 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:09.944051 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9f34486d-ab18-4713-815a-8bcac182a8f6 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:10.035288 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-90a880f3-81d9-47fb-b2d5-1d0287806a13 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef078fe46d418c95f35e1f0bdd2f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8f338b40e4d7e9a6249084bcdaa73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:10.045525 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-90a880f3-81d9-47fb-b2d5-1d0287806a13 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] 10.222.0.30 "GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db" status: 200 len: 1314 microversion: 2.1 time: 0.321381 Aug 09 07:03:10.049162 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 46/103] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:09 2022] GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:10.055809 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-bae70eaf-e881-4370-936e-76f361579362 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:10.056977 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-bae70eaf-e881-4370-936e-76f361579362 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:10.064472 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-bae70eaf-e881-4370-936e-76f361579362 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:10.065664 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-bae70eaf-e881-4370-936e-76f361579362 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:10.066428 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-bae70eaf-e881-4370-936e-76f361579362 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:10.067471 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-bae70eaf-e881-4370-936e-76f361579362 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:10.068095 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-bae70eaf-e881-4370-936e-76f361579362 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:10.068657 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-bae70eaf-e881-4370-936e-76f361579362 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:10.116484 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=28 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:10.440958 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-9f34486d-ab18-4713-815a-8bcac182a8f6 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:10.457254 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-9f34486d-ab18-4713-815a-8bcac182a8f6 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1363 microversion: 2.1 time: 0.536897 Aug 09 07:03:10.460288 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 58/104] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:09 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1363 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:10.480302 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-1abe9d78-14c8-46ad-905f-56309cf80ab5 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:10.481113 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-1abe9d78-14c8-46ad-905f-56309cf80ab5 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:10.488088 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1abe9d78-14c8-46ad-905f-56309cf80ab5 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:10.488803 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1abe9d78-14c8-46ad-905f-56309cf80ab5 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:10.489841 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-bae70eaf-e881-4370-936e-76f361579362 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:10.490308 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1abe9d78-14c8-46ad-905f-56309cf80ab5 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:10.491475 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1abe9d78-14c8-46ad-905f-56309cf80ab5 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:10.492117 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1abe9d78-14c8-46ad-905f-56309cf80ab5 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:10.492751 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1abe9d78-14c8-46ad-905f-56309cf80ab5 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:10.507959 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-bae70eaf-e881-4370-936e-76f361579362 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:10.513916 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-bae70eaf-e881-4370-936e-76f361579362 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:10.517829 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-bae70eaf-e881-4370-936e-76f361579362 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1406 microversion: 2.20 time: 0.464490 Aug 09 07:03:10.518706 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 47/105] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:03:10 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1406 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:03:10.641299 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-57684842-bcba-4ab3-a1ec-f73eed886f6c tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:10.641889 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-57684842-bcba-4ab3-a1ec-f73eed886f6c tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: 66d40f73-633e-4564-a6d4-732cd15dcb12] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:10.657057 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-57684842-bcba-4ab3-a1ec-f73eed886f6c tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:10.657736 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-57684842-bcba-4ab3-a1ec-f73eed886f6c tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:10.658317 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-57684842-bcba-4ab3-a1ec-f73eed886f6c tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:10.659176 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-57684842-bcba-4ab3-a1ec-f73eed886f6c tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:10.659867 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-57684842-bcba-4ab3-a1ec-f73eed886f6c tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:10.660429 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-57684842-bcba-4ab3-a1ec-f73eed886f6c tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:10.851542 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-1abe9d78-14c8-46ad-905f-56309cf80ab5 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:10.865248 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-1abe9d78-14c8-46ad-905f-56309cf80ab5 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 200 len: 1321 microversion: 2.1 time: 0.390048 Aug 09 07:03:10.874609 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 59/106] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:10 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 1321 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:10.966390 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-57684842-bcba-4ab3-a1ec-f73eed886f6c tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:10.974275 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-57684842-bcba-4ab3-a1ec-f73eed886f6c tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12" status: 200 len: 1367 microversion: 2.1 time: 0.338746 Aug 09 07:03:10.979060 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 48/107] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:10 2022] GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12 => generated 1367 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:11.068864 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b7d2134f-7224-4a2b-936c-afa5f2187c71 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:11.069481 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b7d2134f-7224-4a2b-936c-afa5f2187c71 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] [instance: 9883f029-68a3-4946-b14b-47721b72f3db] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:11.091893 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b7d2134f-7224-4a2b-936c-afa5f2187c71 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:11.092395 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b7d2134f-7224-4a2b-936c-afa5f2187c71 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:11.096066 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b7d2134f-7224-4a2b-936c-afa5f2187c71 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:11.097846 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b7d2134f-7224-4a2b-936c-afa5f2187c71 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:11.099234 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b7d2134f-7224-4a2b-936c-afa5f2187c71 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:11.100773 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b7d2134f-7224-4a2b-936c-afa5f2187c71 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:11.294455 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b7d2134f-7224-4a2b-936c-afa5f2187c71 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef078fe46d418c95f35e1f0bdd2f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8f338b40e4d7e9a6249084bcdaa73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:11.304722 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b7d2134f-7224-4a2b-936c-afa5f2187c71 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] 10.222.0.30 "GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db" status: 200 len: 1314 microversion: 2.1 time: 0.240283 Aug 09 07:03:11.319881 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 60/108] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:11 2022] GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:11.348736 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [req-d48a7a87-9eeb-47cb-b0a7-5e02d487a360 req-83337176-e9c2-46fb-8d9c-7e714a811f09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9883f029-68a3-4946-b14b-47721b72f3db", "name": "network-vif-plugged", "status": "completed", "tag": "823c14f0-b1a9-4950-bf0e-c762cdeb2d8f"}]} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:03:11.374494 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-d48a7a87-9eeb-47cb-b0a7-5e02d487a360 req-83337176-e9c2-46fb-8d9c-7e714a811f09 service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:11.376589 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-d48a7a87-9eeb-47cb-b0a7-5e02d487a360 req-83337176-e9c2-46fb-8d9c-7e714a811f09 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:11.377412 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-d48a7a87-9eeb-47cb-b0a7-5e02d487a360 req-83337176-e9c2-46fb-8d9c-7e714a811f09 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:11.402853 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.compute.server_external_events [req-d48a7a87-9eeb-47cb-b0a7-5e02d487a360 req-83337176-e9c2-46fb-8d9c-7e714a811f09 service nova] Creating event network-vif-plugged:823c14f0-b1a9-4950-bf0e-c762cdeb2d8f for instance 9883f029-68a3-4946-b14b-47721b72f3db on hv-cinder-85251 Aug 09 07:03:11.413786 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [req-d48a7a87-9eeb-47cb-b0a7-5e02d487a360 req-83337176-e9c2-46fb-8d9c-7e714a811f09 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.229205 Aug 09 07:03:11.416770 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 49/109] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:03:11.485032 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4cfce877-eda8-4995-99b4-86249f3c2e12 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:11.485955 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4cfce877-eda8-4995-99b4-86249f3c2e12 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:11.494763 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4cfce877-eda8-4995-99b4-86249f3c2e12 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:11.495257 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4cfce877-eda8-4995-99b4-86249f3c2e12 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:11.495727 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4cfce877-eda8-4995-99b4-86249f3c2e12 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:11.496433 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4cfce877-eda8-4995-99b4-86249f3c2e12 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:11.496887 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4cfce877-eda8-4995-99b4-86249f3c2e12 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:11.497618 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4cfce877-eda8-4995-99b4-86249f3c2e12 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:11.543937 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-c97d0d1f-ec4e-4499-80ba-c7da5651b69f tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:11.545343 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-c97d0d1f-ec4e-4499-80ba-c7da5651b69f tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:11.557891 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c97d0d1f-ec4e-4499-80ba-c7da5651b69f tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:11.558905 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c97d0d1f-ec4e-4499-80ba-c7da5651b69f tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:11.559610 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c97d0d1f-ec4e-4499-80ba-c7da5651b69f tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:11.560859 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c97d0d1f-ec4e-4499-80ba-c7da5651b69f tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:11.561631 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c97d0d1f-ec4e-4499-80ba-c7da5651b69f tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:11.562242 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c97d0d1f-ec4e-4499-80ba-c7da5651b69f tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:11.764633 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4cfce877-eda8-4995-99b4-86249f3c2e12 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:11.778106 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4cfce877-eda8-4995-99b4-86249f3c2e12 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1363 microversion: 2.1 time: 0.299076 Aug 09 07:03:11.779431 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 61/110] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:11 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1363 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:11.788780 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-c97d0d1f-ec4e-4499-80ba-c7da5651b69f tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:11.798810 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-c97d0d1f-ec4e-4499-80ba-c7da5651b69f tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:11.801606 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-c97d0d1f-ec4e-4499-80ba-c7da5651b69f tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:11.803845 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-c97d0d1f-ec4e-4499-80ba-c7da5651b69f tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1406 microversion: 2.20 time: 0.266929 Aug 09 07:03:11.804796 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 50/111] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:03:11 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1406 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 07:03:11.823627 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-83db1ba4-d32c-478f-ae90-e36f60fd6dbd req-4b3662fb-15db-4e63-a3ba-9940805d6d4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2236b6b2-39b4-4b81-bb86-006774babc2e", "tag": "ada64d06-0764-4487-9425-780bad419035"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:03:11.832799 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-83db1ba4-d32c-478f-ae90-e36f60fd6dbd req-4b3662fb-15db-4e63-a3ba-9940805d6d4c service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:11.833373 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-83db1ba4-d32c-478f-ae90-e36f60fd6dbd req-4b3662fb-15db-4e63-a3ba-9940805d6d4c service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:11.833788 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-83db1ba4-d32c-478f-ae90-e36f60fd6dbd req-4b3662fb-15db-4e63-a3ba-9940805d6d4c service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:11.853315 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-83db1ba4-d32c-478f-ae90-e36f60fd6dbd req-4b3662fb-15db-4e63-a3ba-9940805d6d4c service nova] Creating event network-changed:ada64d06-0764-4487-9425-780bad419035 for instance 2236b6b2-39b4-4b81-bb86-006774babc2e on hv-cinder-85251 Aug 09 07:03:11.861038 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-83db1ba4-d32c-478f-ae90-e36f60fd6dbd req-4b3662fb-15db-4e63-a3ba-9940805d6d4c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041897 Aug 09 07:03:11.861038 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 62/112] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:03:11.897927 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-f1c80765-8770-4ad2-979c-bf1cbdfb9eb4 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:11.898552 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-f1c80765-8770-4ad2-979c-bf1cbdfb9eb4 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:11.904960 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f1c80765-8770-4ad2-979c-bf1cbdfb9eb4 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:11.905442 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f1c80765-8770-4ad2-979c-bf1cbdfb9eb4 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:11.906158 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f1c80765-8770-4ad2-979c-bf1cbdfb9eb4 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:11.906933 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f1c80765-8770-4ad2-979c-bf1cbdfb9eb4 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:11.907587 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f1c80765-8770-4ad2-979c-bf1cbdfb9eb4 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:11.908105 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f1c80765-8770-4ad2-979c-bf1cbdfb9eb4 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:12.001666 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-ceced1ae-3030-47b4-be23-d09037a75492 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:12.005026 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-ceced1ae-3030-47b4-be23-d09037a75492 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: 66d40f73-633e-4564-a6d4-732cd15dcb12] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:12.015228 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ceced1ae-3030-47b4-be23-d09037a75492 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:12.016056 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ceced1ae-3030-47b4-be23-d09037a75492 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:12.016497 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ceced1ae-3030-47b4-be23-d09037a75492 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:12.017197 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ceced1ae-3030-47b4-be23-d09037a75492 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:12.017803 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ceced1ae-3030-47b4-be23-d09037a75492 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:12.018405 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ceced1ae-3030-47b4-be23-d09037a75492 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:12.190106 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-f1c80765-8770-4ad2-979c-bf1cbdfb9eb4 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:12.207820 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-f1c80765-8770-4ad2-979c-bf1cbdfb9eb4 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 200 len: 1321 microversion: 2.1 time: 0.306484 Aug 09 07:03:12.208449 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 51/113] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:11 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 1321 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:03:12.296279 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ceced1ae-3030-47b4-be23-d09037a75492 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:12.304621 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-ceced1ae-3030-47b4-be23-d09037a75492 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12" status: 200 len: 1367 microversion: 2.1 time: 0.308966 Aug 09 07:03:12.316902 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 63/114] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:11 2022] GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12 => generated 1367 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:12.327391 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-e69ba660-90cc-4599-b171-012a701dc5c7 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:12.328404 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-e69ba660-90cc-4599-b171-012a701dc5c7 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] [instance: 9883f029-68a3-4946-b14b-47721b72f3db] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:12.337055 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e69ba660-90cc-4599-b171-012a701dc5c7 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:12.337811 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e69ba660-90cc-4599-b171-012a701dc5c7 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:12.338456 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e69ba660-90cc-4599-b171-012a701dc5c7 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:12.339883 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e69ba660-90cc-4599-b171-012a701dc5c7 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:12.340899 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e69ba660-90cc-4599-b171-012a701dc5c7 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:12.341778 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e69ba660-90cc-4599-b171-012a701dc5c7 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:12.510473 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-e69ba660-90cc-4599-b171-012a701dc5c7 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef078fe46d418c95f35e1f0bdd2f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8f338b40e4d7e9a6249084bcdaa73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:12.519133 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-e69ba660-90cc-4599-b171-012a701dc5c7 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] 10.222.0.30 "GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db" status: 200 len: 1314 microversion: 2.1 time: 0.196651 Aug 09 07:03:12.520164 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 52/115] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:12 2022] GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:12.801917 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-022ffc8d-2286-42b9-87c8-7f4d1e7fd57f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:12.802535 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-022ffc8d-2286-42b9-87c8-7f4d1e7fd57f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:12.813138 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-022ffc8d-2286-42b9-87c8-7f4d1e7fd57f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:12.813734 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-022ffc8d-2286-42b9-87c8-7f4d1e7fd57f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:12.814204 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-022ffc8d-2286-42b9-87c8-7f4d1e7fd57f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:12.814899 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-022ffc8d-2286-42b9-87c8-7f4d1e7fd57f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:12.815351 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-022ffc8d-2286-42b9-87c8-7f4d1e7fd57f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:12.815803 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-022ffc8d-2286-42b9-87c8-7f4d1e7fd57f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:12.827121 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-f8c55525-3bb3-4322-874a-2c1e0e9504e4 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:12.827924 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-f8c55525-3bb3-4322-874a-2c1e0e9504e4 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:12.833806 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f8c55525-3bb3-4322-874a-2c1e0e9504e4 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:12.834298 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f8c55525-3bb3-4322-874a-2c1e0e9504e4 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:12.834735 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f8c55525-3bb3-4322-874a-2c1e0e9504e4 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:12.835435 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f8c55525-3bb3-4322-874a-2c1e0e9504e4 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:12.835930 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f8c55525-3bb3-4322-874a-2c1e0e9504e4 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:12.836941 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f8c55525-3bb3-4322-874a-2c1e0e9504e4 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:13.033014 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-022ffc8d-2286-42b9-87c8-7f4d1e7fd57f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:13.037943 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-f8c55525-3bb3-4322-874a-2c1e0e9504e4 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:13.040576 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_cell1:SELECT=100 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:13.043375 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-022ffc8d-2286-42b9-87c8-7f4d1e7fd57f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1363 microversion: 2.1 time: 0.244593 Aug 09 07:03:13.044388 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 64/116] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:12 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1363 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:13.048243 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-f8c55525-3bb3-4322-874a-2c1e0e9504e4 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:13.049983 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-f8c55525-3bb3-4322-874a-2c1e0e9504e4 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:13.051152 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-f8c55525-3bb3-4322-874a-2c1e0e9504e4 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1406 microversion: 2.20 time: 0.227896 Aug 09 07:03:13.051799 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 53/117] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:03:12 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1406 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:03:13.232960 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-ceb7624f-0ff7-4638-86f6-d3ec4719eb1f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:13.232960 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-ceb7624f-0ff7-4638-86f6-d3ec4719eb1f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:13.236993 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ceb7624f-0ff7-4638-86f6-d3ec4719eb1f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:13.237472 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ceb7624f-0ff7-4638-86f6-d3ec4719eb1f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:13.237904 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ceb7624f-0ff7-4638-86f6-d3ec4719eb1f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:13.238625 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ceb7624f-0ff7-4638-86f6-d3ec4719eb1f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:13.239078 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ceb7624f-0ff7-4638-86f6-d3ec4719eb1f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:13.239505 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ceb7624f-0ff7-4638-86f6-d3ec4719eb1f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:13.331360 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-20f2ee50-ff81-4ab6-a013-d44233dd6e3b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:13.331997 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-20f2ee50-ff81-4ab6-a013-d44233dd6e3b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: 66d40f73-633e-4564-a6d4-732cd15dcb12] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:13.339714 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-20f2ee50-ff81-4ab6-a013-d44233dd6e3b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:13.340212 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-20f2ee50-ff81-4ab6-a013-d44233dd6e3b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:13.340657 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-20f2ee50-ff81-4ab6-a013-d44233dd6e3b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:13.341367 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-20f2ee50-ff81-4ab6-a013-d44233dd6e3b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:13.341978 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-20f2ee50-ff81-4ab6-a013-d44233dd6e3b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:13.342413 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-20f2ee50-ff81-4ab6-a013-d44233dd6e3b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:13.381657 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ceb7624f-0ff7-4638-86f6-d3ec4719eb1f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:13.391052 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-ceb7624f-0ff7-4638-86f6-d3ec4719eb1f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 200 len: 1321 microversion: 2.1 time: 0.166003 Aug 09 07:03:13.391984 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 65/118] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:13 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:13.494245 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-20f2ee50-ff81-4ab6-a013-d44233dd6e3b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:13.507295 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-20f2ee50-ff81-4ab6-a013-d44233dd6e3b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12" status: 200 len: 1367 microversion: 2.1 time: 0.179710 Aug 09 07:03:13.507883 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 54/119] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:13 2022] GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12 => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:13.540627 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-85e0c75e-37cb-4f16-a107-aeb8fee5f7bf tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:13.541164 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-85e0c75e-37cb-4f16-a107-aeb8fee5f7bf tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] [instance: 9883f029-68a3-4946-b14b-47721b72f3db] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:13.547020 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-85e0c75e-37cb-4f16-a107-aeb8fee5f7bf tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:13.547497 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-85e0c75e-37cb-4f16-a107-aeb8fee5f7bf tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:13.547965 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-85e0c75e-37cb-4f16-a107-aeb8fee5f7bf tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:13.548646 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-85e0c75e-37cb-4f16-a107-aeb8fee5f7bf tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:13.549092 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-85e0c75e-37cb-4f16-a107-aeb8fee5f7bf tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:13.549510 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-85e0c75e-37cb-4f16-a107-aeb8fee5f7bf tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:13.553660 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=100 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:13.685850 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-85e0c75e-37cb-4f16-a107-aeb8fee5f7bf tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef078fe46d418c95f35e1f0bdd2f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8f338b40e4d7e9a6249084bcdaa73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:13.697799 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-85e0c75e-37cb-4f16-a107-aeb8fee5f7bf tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] 10.222.0.30 "GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db" status: 200 len: 1314 microversion: 2.1 time: 0.161519 Aug 09 07:03:13.698367 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 66/120] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:13 2022] GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:14.064844 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-3b08812a-3844-4991-9e2d-d22544f485e6 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:14.065577 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-3b08812a-3844-4991-9e2d-d22544f485e6 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:14.072342 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3b08812a-3844-4991-9e2d-d22544f485e6 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:14.072826 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3b08812a-3844-4991-9e2d-d22544f485e6 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:14.073422 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3b08812a-3844-4991-9e2d-d22544f485e6 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:14.074252 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3b08812a-3844-4991-9e2d-d22544f485e6 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:14.074700 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3b08812a-3844-4991-9e2d-d22544f485e6 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:14.075119 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3b08812a-3844-4991-9e2d-d22544f485e6 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:14.075232 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4b77238f-40f6-481d-88a5-ddce4a74e811 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:14.075844 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4b77238f-40f6-481d-88a5-ddce4a74e811 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:14.083442 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4b77238f-40f6-481d-88a5-ddce4a74e811 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:14.084011 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4b77238f-40f6-481d-88a5-ddce4a74e811 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:14.084518 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4b77238f-40f6-481d-88a5-ddce4a74e811 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:14.085277 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4b77238f-40f6-481d-88a5-ddce4a74e811 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:14.085973 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4b77238f-40f6-481d-88a5-ddce4a74e811 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:14.087022 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4b77238f-40f6-481d-88a5-ddce4a74e811 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:14.312504 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-3b08812a-3844-4991-9e2d-d22544f485e6 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:14.320178 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-3b08812a-3844-4991-9e2d-d22544f485e6 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1363 microversion: 2.1 time: 0.259023 Aug 09 07:03:14.321449 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 55/121] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:14 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1363 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:14.323116 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4b77238f-40f6-481d-88a5-ddce4a74e811 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:14.332512 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4b77238f-40f6-481d-88a5-ddce4a74e811 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:14.334133 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4b77238f-40f6-481d-88a5-ddce4a74e811 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:14.335471 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4b77238f-40f6-481d-88a5-ddce4a74e811 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1406 microversion: 2.20 time: 0.265566 Aug 09 07:03:14.336121 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 67/122] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:03:14 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1406 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:03:14.415289 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-24a765cd-cbb8-44c5-8315-ff4c2f597647 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:14.415931 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-24a765cd-cbb8-44c5-8315-ff4c2f597647 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:14.427378 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-24a765cd-cbb8-44c5-8315-ff4c2f597647 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:14.427905 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-24a765cd-cbb8-44c5-8315-ff4c2f597647 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:14.428337 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-24a765cd-cbb8-44c5-8315-ff4c2f597647 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:14.429062 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-24a765cd-cbb8-44c5-8315-ff4c2f597647 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:14.429507 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-24a765cd-cbb8-44c5-8315-ff4c2f597647 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:14.430034 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-24a765cd-cbb8-44c5-8315-ff4c2f597647 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:14.528579 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d6ca0931-3de1-403d-bdac-e459fe666d12 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:14.529184 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-d6ca0931-3de1-403d-bdac-e459fe666d12 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: 66d40f73-633e-4564-a6d4-732cd15dcb12] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:14.536710 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d6ca0931-3de1-403d-bdac-e459fe666d12 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:14.537385 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d6ca0931-3de1-403d-bdac-e459fe666d12 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:14.538028 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d6ca0931-3de1-403d-bdac-e459fe666d12 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:14.538821 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d6ca0931-3de1-403d-bdac-e459fe666d12 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:14.539383 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d6ca0931-3de1-403d-bdac-e459fe666d12 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:14.540375 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d6ca0931-3de1-403d-bdac-e459fe666d12 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:14.573939 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-24a765cd-cbb8-44c5-8315-ff4c2f597647 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:14.581643 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-24a765cd-cbb8-44c5-8315-ff4c2f597647 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 200 len: 1321 microversion: 2.1 time: 0.173082 Aug 09 07:03:14.582525 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 56/123] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:14 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:14.683046 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d6ca0931-3de1-403d-bdac-e459fe666d12 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:14.690634 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-d6ca0931-3de1-403d-bdac-e459fe666d12 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12" status: 200 len: 1367 microversion: 2.1 time: 0.166053 Aug 09 07:03:14.691384 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 68/124] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:14 2022] GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:03:14.718105 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-b2bd1961-0d07-49e6-a800-509777bee31c tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:14.718713 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-b2bd1961-0d07-49e6-a800-509777bee31c tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] [instance: 9883f029-68a3-4946-b14b-47721b72f3db] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:14.724520 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b2bd1961-0d07-49e6-a800-509777bee31c tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:14.724989 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b2bd1961-0d07-49e6-a800-509777bee31c tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:14.725411 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b2bd1961-0d07-49e6-a800-509777bee31c tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:14.726091 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b2bd1961-0d07-49e6-a800-509777bee31c tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:14.726536 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b2bd1961-0d07-49e6-a800-509777bee31c tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:14.727101 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b2bd1961-0d07-49e6-a800-509777bee31c tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:14.928837 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-b2bd1961-0d07-49e6-a800-509777bee31c tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef078fe46d418c95f35e1f0bdd2f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8f338b40e4d7e9a6249084bcdaa73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:14.937263 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-b2bd1961-0d07-49e6-a800-509777bee31c tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] 10.222.0.30 "GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db" status: 200 len: 1314 microversion: 2.1 time: 0.222902 Aug 09 07:03:14.937828 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 57/125] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:14 2022] GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:15.343429 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-ef88df21-f984-455c-9e94-48b0e45803cf tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:15.345040 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-ef88df21-f984-455c-9e94-48b0e45803cf tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:15.353434 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ef88df21-f984-455c-9e94-48b0e45803cf tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:15.355462 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ef88df21-f984-455c-9e94-48b0e45803cf tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:15.355936 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ef88df21-f984-455c-9e94-48b0e45803cf tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:15.356649 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ef88df21-f984-455c-9e94-48b0e45803cf tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:15.357111 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ef88df21-f984-455c-9e94-48b0e45803cf tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:15.357529 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ef88df21-f984-455c-9e94-48b0e45803cf tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:15.359143 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-aca09a2c-181c-4f0c-995a-2e3bea2db0b3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:15.359923 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-aca09a2c-181c-4f0c-995a-2e3bea2db0b3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:15.368449 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-aca09a2c-181c-4f0c-995a-2e3bea2db0b3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:15.369390 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-aca09a2c-181c-4f0c-995a-2e3bea2db0b3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:15.370191 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-aca09a2c-181c-4f0c-995a-2e3bea2db0b3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:15.394929 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-aca09a2c-181c-4f0c-995a-2e3bea2db0b3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:15.397766 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-aca09a2c-181c-4f0c-995a-2e3bea2db0b3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:15.398447 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-aca09a2c-181c-4f0c-995a-2e3bea2db0b3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:15.450023 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=6 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:15.651670 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-aca09a2c-181c-4f0c-995a-2e3bea2db0b3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:15.658939 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ef88df21-f984-455c-9e94-48b0e45803cf tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:15.663186 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-aca09a2c-181c-4f0c-995a-2e3bea2db0b3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:15.666447 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-aca09a2c-181c-4f0c-995a-2e3bea2db0b3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:15.668707 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-aca09a2c-181c-4f0c-995a-2e3bea2db0b3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1406 microversion: 2.20 time: 0.313220 Aug 09 07:03:15.669383 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-ef88df21-f984-455c-9e94-48b0e45803cf tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1363 microversion: 2.1 time: 0.331067 Aug 09 07:03:15.684891 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 69/126] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:15 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1363 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:15.685600 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 58/127] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:03:15 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1406 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:03:15.689827 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-0cc48303-277f-45c9-88fc-aa3ddac18e3c req-ae483705-d9a7-4c36-8b95-522e5c4dcb27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64c9caf8-5201-418c-ba08-9bc9f5a55f57", "name": "network-vif-plugged", "status": "completed", "tag": "4d513942-ac8d-433b-899e-8512feefa9a7"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:03:15.690914 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-7b99d756-eec4-47f2-b1fb-4d23ebbc66f0 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:15.691813 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-7b99d756-eec4-47f2-b1fb-4d23ebbc66f0 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:15.700890 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7b99d756-eec4-47f2-b1fb-4d23ebbc66f0 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:15.701671 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7b99d756-eec4-47f2-b1fb-4d23ebbc66f0 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:15.702288 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7b99d756-eec4-47f2-b1fb-4d23ebbc66f0 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:15.703163 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7b99d756-eec4-47f2-b1fb-4d23ebbc66f0 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:15.704649 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7b99d756-eec4-47f2-b1fb-4d23ebbc66f0 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:15.706573 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7b99d756-eec4-47f2-b1fb-4d23ebbc66f0 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:15.720006 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-0cc48303-277f-45c9-88fc-aa3ddac18e3c req-ae483705-d9a7-4c36-8b95-522e5c4dcb27 service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:15.720531 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-0cc48303-277f-45c9-88fc-aa3ddac18e3c req-ae483705-d9a7-4c36-8b95-522e5c4dcb27 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:15.721226 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-0cc48303-277f-45c9-88fc-aa3ddac18e3c req-ae483705-d9a7-4c36-8b95-522e5c4dcb27 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:15.760943 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-0cc48303-277f-45c9-88fc-aa3ddac18e3c req-ae483705-d9a7-4c36-8b95-522e5c4dcb27 service nova] Creating event network-vif-plugged:4d513942-ac8d-433b-899e-8512feefa9a7 for instance 64c9caf8-5201-418c-ba08-9bc9f5a55f57 on hv-cinder-85251 Aug 09 07:03:15.770226 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-0cc48303-277f-45c9-88fc-aa3ddac18e3c req-ae483705-d9a7-4c36-8b95-522e5c4dcb27 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082994 Aug 09 07:03:15.771641 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 70/128] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:03:15.777551 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e9643268-ae95-4082-a30f-7ef064660d4f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:15.778599 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-e9643268-ae95-4082-a30f-7ef064660d4f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: 66d40f73-633e-4564-a6d4-732cd15dcb12] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:15.786530 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e9643268-ae95-4082-a30f-7ef064660d4f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:15.787369 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e9643268-ae95-4082-a30f-7ef064660d4f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:15.788155 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e9643268-ae95-4082-a30f-7ef064660d4f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:15.792527 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e9643268-ae95-4082-a30f-7ef064660d4f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:15.794133 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e9643268-ae95-4082-a30f-7ef064660d4f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:15.795758 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e9643268-ae95-4082-a30f-7ef064660d4f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:15.979842 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-7b99d756-eec4-47f2-b1fb-4d23ebbc66f0 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:16.000323 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-7b99d756-eec4-47f2-b1fb-4d23ebbc66f0 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 200 len: 1321 microversion: 2.1 time: 0.313396 Aug 09 07:03:16.016949 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 59/129] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:15 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 1321 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:16.030168 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-eacfb4e2-77b4-49ee-aa83-eeef1305a3a3 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:16.030168 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-eacfb4e2-77b4-49ee-aa83-eeef1305a3a3 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] [instance: 9883f029-68a3-4946-b14b-47721b72f3db] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:16.038809 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-eacfb4e2-77b4-49ee-aa83-eeef1305a3a3 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:16.039948 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-eacfb4e2-77b4-49ee-aa83-eeef1305a3a3 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:16.040140 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e9643268-ae95-4082-a30f-7ef064660d4f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:16.040685 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-eacfb4e2-77b4-49ee-aa83-eeef1305a3a3 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:16.041443 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-eacfb4e2-77b4-49ee-aa83-eeef1305a3a3 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:16.042008 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-eacfb4e2-77b4-49ee-aa83-eeef1305a3a3 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:16.042445 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-eacfb4e2-77b4-49ee-aa83-eeef1305a3a3 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:16.049723 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-e9643268-ae95-4082-a30f-7ef064660d4f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12" status: 200 len: 1367 microversion: 2.1 time: 0.276683 Aug 09 07:03:16.050402 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 71/130] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:15 2022] GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12 => generated 1367 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:16.243649 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-eacfb4e2-77b4-49ee-aa83-eeef1305a3a3 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef078fe46d418c95f35e1f0bdd2f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8f338b40e4d7e9a6249084bcdaa73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:16.251522 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-eacfb4e2-77b4-49ee-aa83-eeef1305a3a3 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] 10.222.0.30 "GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db" status: 200 len: 1314 microversion: 2.1 time: 0.233492 Aug 09 07:03:16.265917 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 60/131] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:16 2022] GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:16.690344 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-7ef79a95-3c34-42b4-ab64-3627458eca19 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:16.690877 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-7ef79a95-3c34-42b4-ab64-3627458eca19 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:16.694225 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-a012f2c0-ebce-4470-8514-178525914a76 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:16.694840 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-a012f2c0-ebce-4470-8514-178525914a76 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:16.697795 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7ef79a95-3c34-42b4-ab64-3627458eca19 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:16.698356 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7ef79a95-3c34-42b4-ab64-3627458eca19 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:16.698978 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7ef79a95-3c34-42b4-ab64-3627458eca19 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:16.699788 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7ef79a95-3c34-42b4-ab64-3627458eca19 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:16.700293 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7ef79a95-3c34-42b4-ab64-3627458eca19 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:16.700728 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7ef79a95-3c34-42b4-ab64-3627458eca19 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:16.701362 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a012f2c0-ebce-4470-8514-178525914a76 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:16.701840 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a012f2c0-ebce-4470-8514-178525914a76 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:16.702269 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a012f2c0-ebce-4470-8514-178525914a76 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:16.702950 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a012f2c0-ebce-4470-8514-178525914a76 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:16.703399 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a012f2c0-ebce-4470-8514-178525914a76 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:16.703840 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a012f2c0-ebce-4470-8514-178525914a76 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:16.960484 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-a012f2c0-ebce-4470-8514-178525914a76 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:16.969876 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-a012f2c0-ebce-4470-8514-178525914a76 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:16.971429 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-a012f2c0-ebce-4470-8514-178525914a76 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:16.972639 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-a012f2c0-ebce-4470-8514-178525914a76 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1406 microversion: 2.20 time: 0.283923 Aug 09 07:03:16.973198 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 61/132] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:03:16 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1406 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:03:16.994138 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-7ef79a95-3c34-42b4-ab64-3627458eca19 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:17.006893 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-7ef79a95-3c34-42b4-ab64-3627458eca19 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1363 microversion: 2.1 time: 0.320098 Aug 09 07:03:17.007477 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 72/133] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:16 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1363 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:17.045399 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-b49ce668-e85f-44ff-b884-86acb8be73f5 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:17.046027 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-b49ce668-e85f-44ff-b884-86acb8be73f5 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:17.053512 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b49ce668-e85f-44ff-b884-86acb8be73f5 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:17.054239 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b49ce668-e85f-44ff-b884-86acb8be73f5 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:17.054732 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b49ce668-e85f-44ff-b884-86acb8be73f5 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:17.055714 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b49ce668-e85f-44ff-b884-86acb8be73f5 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:17.056360 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b49ce668-e85f-44ff-b884-86acb8be73f5 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:17.056790 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b49ce668-e85f-44ff-b884-86acb8be73f5 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:17.072961 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-df399e6d-0afd-4a07-9d54-d1bfacf2e9bb tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:17.074145 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-df399e6d-0afd-4a07-9d54-d1bfacf2e9bb tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: 66d40f73-633e-4564-a6d4-732cd15dcb12] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:17.083569 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-df399e6d-0afd-4a07-9d54-d1bfacf2e9bb tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:17.084410 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-df399e6d-0afd-4a07-9d54-d1bfacf2e9bb tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:17.085078 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-df399e6d-0afd-4a07-9d54-d1bfacf2e9bb tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:17.087436 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-df399e6d-0afd-4a07-9d54-d1bfacf2e9bb tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:17.088481 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-df399e6d-0afd-4a07-9d54-d1bfacf2e9bb tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:17.088660 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-df399e6d-0afd-4a07-9d54-d1bfacf2e9bb tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:17.338636 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-b49ce668-e85f-44ff-b884-86acb8be73f5 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:17.352893 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-b49ce668-e85f-44ff-b884-86acb8be73f5 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 200 len: 1321 microversion: 2.1 time: 0.313964 Aug 09 07:03:17.357131 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-df399e6d-0afd-4a07-9d54-d1bfacf2e9bb tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:17.357356 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 62/134] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:17 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 1321 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:17.363180 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-236ab9e4-174c-482d-906d-138555810004 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:17.366349 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-236ab9e4-174c-482d-906d-138555810004 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] [instance: 9883f029-68a3-4946-b14b-47721b72f3db] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:17.383496 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-236ab9e4-174c-482d-906d-138555810004 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:17.389316 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-236ab9e4-174c-482d-906d-138555810004 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:17.390637 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-236ab9e4-174c-482d-906d-138555810004 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:17.390919 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-df399e6d-0afd-4a07-9d54-d1bfacf2e9bb tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12" status: 200 len: 1367 microversion: 2.1 time: 0.323407 Aug 09 07:03:17.392422 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-236ab9e4-174c-482d-906d-138555810004 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:17.394011 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 73/135] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:17 2022] GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12 => generated 1367 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:03:17.400292 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-236ab9e4-174c-482d-906d-138555810004 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:17.400885 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-236ab9e4-174c-482d-906d-138555810004 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:17.722792 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-236ab9e4-174c-482d-906d-138555810004 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef078fe46d418c95f35e1f0bdd2f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8f338b40e4d7e9a6249084bcdaa73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:17.751791 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-236ab9e4-174c-482d-906d-138555810004 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] 10.222.0.30 "GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db" status: 200 len: 1314 microversion: 2.1 time: 0.390297 Aug 09 07:03:17.754508 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 63/136] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:17 2022] GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db => generated 1314 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:17.834168 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-17329806-b8dc-42bd-a79c-30372c075335 req-3eea063d-0769-49cf-a82b-dbfeec4c637d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66d40f73-633e-4564-a6d4-732cd15dcb12", "name": "network-vif-plugged", "status": "completed", "tag": "6a17b65c-bc72-41ab-af44-8de8ed744b45"}, {"server_uuid": "9fe62967-63ba-4d67-88c4-25e1c1d445fa", "name": "network-vif-plugged", "status": "completed", "tag": "c3f302ed-7425-4dd7-9fc2-33ba9fdf4954"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:03:17.861497 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-17329806-b8dc-42bd-a79c-30372c075335 req-3eea063d-0769-49cf-a82b-dbfeec4c637d service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:17.862053 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-17329806-b8dc-42bd-a79c-30372c075335 req-3eea063d-0769-49cf-a82b-dbfeec4c637d service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:17.862602 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-17329806-b8dc-42bd-a79c-30372c075335 req-3eea063d-0769-49cf-a82b-dbfeec4c637d service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:17.883516 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-17329806-b8dc-42bd-a79c-30372c075335 req-3eea063d-0769-49cf-a82b-dbfeec4c637d service nova] Creating event network-vif-plugged:6a17b65c-bc72-41ab-af44-8de8ed744b45 for instance 66d40f73-633e-4564-a6d4-732cd15dcb12 on hv-cinder-85251 Aug 09 07:03:17.892231 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-17329806-b8dc-42bd-a79c-30372c075335 req-3eea063d-0769-49cf-a82b-dbfeec4c637d service nova] Creating event network-vif-plugged:c3f302ed-7425-4dd7-9fc2-33ba9fdf4954 for instance 9fe62967-63ba-4d67-88c4-25e1c1d445fa on hv-cinder-85251 Aug 09 07:03:17.905316 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-17329806-b8dc-42bd-a79c-30372c075335 req-3eea063d-0769-49cf-a82b-dbfeec4c637d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.075893 Aug 09 07:03:17.905922 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 74/137] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:03:17.997940 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-9d2995e5-fa8d-437b-b7ee-ab26e345a812 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:17.998565 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-9d2995e5-fa8d-437b-b7ee-ab26e345a812 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:18.008548 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9d2995e5-fa8d-437b-b7ee-ab26e345a812 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:18.009114 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9d2995e5-fa8d-437b-b7ee-ab26e345a812 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:18.009670 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9d2995e5-fa8d-437b-b7ee-ab26e345a812 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:18.010380 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9d2995e5-fa8d-437b-b7ee-ab26e345a812 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:18.010829 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9d2995e5-fa8d-437b-b7ee-ab26e345a812 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:18.012487 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9d2995e5-fa8d-437b-b7ee-ab26e345a812 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:18.044231 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-fc72245b-31b8-4c87-a5e7-5f7d7626cf6f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:18.044946 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-fc72245b-31b8-4c87-a5e7-5f7d7626cf6f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:18.064835 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fc72245b-31b8-4c87-a5e7-5f7d7626cf6f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:18.065325 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fc72245b-31b8-4c87-a5e7-5f7d7626cf6f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:18.068599 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fc72245b-31b8-4c87-a5e7-5f7d7626cf6f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:18.069429 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fc72245b-31b8-4c87-a5e7-5f7d7626cf6f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:18.072717 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fc72245b-31b8-4c87-a5e7-5f7d7626cf6f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:18.076580 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fc72245b-31b8-4c87-a5e7-5f7d7626cf6f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:18.288614 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-9d2995e5-fa8d-437b-b7ee-ab26e345a812 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:18.298545 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-9d2995e5-fa8d-437b-b7ee-ab26e345a812 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:18.300501 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-9d2995e5-fa8d-437b-b7ee-ab26e345a812 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:18.302679 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-9d2995e5-fa8d-437b-b7ee-ab26e345a812 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1406 microversion: 2.20 time: 0.310771 Aug 09 07:03:18.304477 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 64/138] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:03:17 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1406 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:03:18.312976 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-fc72245b-31b8-4c87-a5e7-5f7d7626cf6f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:18.324541 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-fc72245b-31b8-4c87-a5e7-5f7d7626cf6f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1363 microversion: 2.1 time: 0.297912 Aug 09 07:03:18.335986 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 75/139] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:18 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1363 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:03:18.376518 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-3ab5c04a-f485-423d-a460-17197b4fbbe2 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:18.377223 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-3ab5c04a-f485-423d-a460-17197b4fbbe2 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:18.386236 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3ab5c04a-f485-423d-a460-17197b4fbbe2 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:18.386818 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3ab5c04a-f485-423d-a460-17197b4fbbe2 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:18.387762 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3ab5c04a-f485-423d-a460-17197b4fbbe2 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:18.388755 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3ab5c04a-f485-423d-a460-17197b4fbbe2 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:18.389658 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3ab5c04a-f485-423d-a460-17197b4fbbe2 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:18.390145 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3ab5c04a-f485-423d-a460-17197b4fbbe2 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:18.419993 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-aed97fca-de18-40cd-be49-b47c01d344f5 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:18.420600 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-aed97fca-de18-40cd-be49-b47c01d344f5 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: 66d40f73-633e-4564-a6d4-732cd15dcb12] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:18.426627 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aed97fca-de18-40cd-be49-b47c01d344f5 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:18.427107 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aed97fca-de18-40cd-be49-b47c01d344f5 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:18.437881 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aed97fca-de18-40cd-be49-b47c01d344f5 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:18.438617 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aed97fca-de18-40cd-be49-b47c01d344f5 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:18.439077 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aed97fca-de18-40cd-be49-b47c01d344f5 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:18.439690 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aed97fca-de18-40cd-be49-b47c01d344f5 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:18.643481 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-3ab5c04a-f485-423d-a460-17197b4fbbe2 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:18.655332 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-3ab5c04a-f485-423d-a460-17197b4fbbe2 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 200 len: 1515 microversion: 2.1 time: 0.282449 Aug 09 07:03:18.658140 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 65/140] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:18 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 1515 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:18.681903 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-bcdc07ac-b88f-480f-86fb-c583c3c955fa tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:03:18.684902 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-aed97fca-de18-40cd-be49-b47c01d344f5 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:18.685037 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-bcdc07ac-b88f-480f-86fb-c583c3c955fa tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:18.693522 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-aed97fca-de18-40cd-be49-b47c01d344f5 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12" status: 200 len: 1367 microversion: 2.1 time: 0.277217 Aug 09 07:03:18.695046 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-bcdc07ac-b88f-480f-86fb-c583c3c955fa tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:18.696599 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-bcdc07ac-b88f-480f-86fb-c583c3c955fa tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:18.697589 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-bcdc07ac-b88f-480f-86fb-c583c3c955fa tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:18.698355 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-bcdc07ac-b88f-480f-86fb-c583c3c955fa tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:18.698895 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-bcdc07ac-b88f-480f-86fb-c583c3c955fa tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:18.699323 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-bcdc07ac-b88f-480f-86fb-c583c3c955fa tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:18.719668 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 76/141] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:18 2022] GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12 => generated 1367 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:18.763740 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.objects.instance [None req-bcdc07ac-b88f-480f-86fb-c583c3c955fa tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lazy-loading 'flavor' on Instance uuid 64c9caf8-5201-418c-ba08-9bc9f5a55f57 {{(pid=117858) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 07:03:18.780117 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-75953cd2-b971-4058-a874-aefa7979d3f1 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:18.781720 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-75953cd2-b971-4058-a874-aefa7979d3f1 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] [instance: 9883f029-68a3-4946-b14b-47721b72f3db] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:18.788752 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-75953cd2-b971-4058-a874-aefa7979d3f1 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:18.789601 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-75953cd2-b971-4058-a874-aefa7979d3f1 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:18.790713 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-75953cd2-b971-4058-a874-aefa7979d3f1 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:18.792776 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-75953cd2-b971-4058-a874-aefa7979d3f1 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:18.793456 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-75953cd2-b971-4058-a874-aefa7979d3f1 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:18.794133 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-75953cd2-b971-4058-a874-aefa7979d3f1 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:18.905744 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-bcdc07ac-b88f-480f-86fb-c583c3c955fa tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "POST /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57/action" status: 200 len: 32 microversion: 2.1 time: 0.228865 Aug 09 07:03:18.909796 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 66/142] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 9 07:03:18 2022] POST /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57/action => generated 32 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 09 07:03:18.922301 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-74723e98-7fb5-4b69-93a1-a3cf0c99529a tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:18.927568 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-74723e98-7fb5-4b69-93a1-a3cf0c99529a tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:18.936767 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-74723e98-7fb5-4b69-93a1-a3cf0c99529a tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:18.937272 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-74723e98-7fb5-4b69-93a1-a3cf0c99529a tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:18.937732 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-74723e98-7fb5-4b69-93a1-a3cf0c99529a tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:18.938573 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-74723e98-7fb5-4b69-93a1-a3cf0c99529a tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:18.939097 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-74723e98-7fb5-4b69-93a1-a3cf0c99529a tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:18.939524 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-74723e98-7fb5-4b69-93a1-a3cf0c99529a tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:19.020498 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-75953cd2-b971-4058-a874-aefa7979d3f1 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef078fe46d418c95f35e1f0bdd2f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8f338b40e4d7e9a6249084bcdaa73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:19.032164 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-75953cd2-b971-4058-a874-aefa7979d3f1 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] 10.222.0.30 "GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db" status: 200 len: 1501 microversion: 2.1 time: 0.256480 Aug 09 07:03:19.033108 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 77/143] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:18 2022] GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db => generated 1501 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:03:19.197501 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-74723e98-7fb5-4b69-93a1-a3cf0c99529a tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:19.208258 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-74723e98-7fb5-4b69-93a1-a3cf0c99529a tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 200 len: 1521 microversion: 2.1 time: 0.292733 Aug 09 07:03:19.209148 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 67/144] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:18 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 1521 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:03:19.327911 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b3e42f87-37cb-43d9-b5f0-658c3276922d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:19.328732 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b3e42f87-37cb-43d9-b5f0-658c3276922d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:19.346301 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b3e42f87-37cb-43d9-b5f0-658c3276922d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:19.346554 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-81912c22-d041-43ed-8c64-c96cf4ae7b38 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:19.347290 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-81912c22-d041-43ed-8c64-c96cf4ae7b38 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:19.348219 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b3e42f87-37cb-43d9-b5f0-658c3276922d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:19.348764 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b3e42f87-37cb-43d9-b5f0-658c3276922d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:19.349527 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b3e42f87-37cb-43d9-b5f0-658c3276922d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:19.350052 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b3e42f87-37cb-43d9-b5f0-658c3276922d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:19.350533 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b3e42f87-37cb-43d9-b5f0-658c3276922d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:19.358485 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-81912c22-d041-43ed-8c64-c96cf4ae7b38 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:19.359075 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-81912c22-d041-43ed-8c64-c96cf4ae7b38 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:19.359840 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-81912c22-d041-43ed-8c64-c96cf4ae7b38 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:19.360547 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-81912c22-d041-43ed-8c64-c96cf4ae7b38 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:19.361229 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-81912c22-d041-43ed-8c64-c96cf4ae7b38 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:19.361799 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-81912c22-d041-43ed-8c64-c96cf4ae7b38 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:19.405118 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:19.566736 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b3e42f87-37cb-43d9-b5f0-658c3276922d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:19.576186 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b3e42f87-37cb-43d9-b5f0-658c3276922d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:19.577933 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b3e42f87-37cb-43d9-b5f0-658c3276922d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:19.579213 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b3e42f87-37cb-43d9-b5f0-658c3276922d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1406 microversion: 2.20 time: 0.256519 Aug 09 07:03:19.579964 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 78/145] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:03:19 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1406 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:03:19.600307 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-81912c22-d041-43ed-8c64-c96cf4ae7b38 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:19.608130 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-81912c22-d041-43ed-8c64-c96cf4ae7b38 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1363 microversion: 2.1 time: 0.266152 Aug 09 07:03:19.608700 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 68/146] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:19 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1363 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:03:19.717222 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a293600f-ae2f-48f3-a562-d2f6e640d8cf tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:19.717898 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-a293600f-ae2f-48f3-a562-d2f6e640d8cf tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: 66d40f73-633e-4564-a6d4-732cd15dcb12] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:19.724229 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a293600f-ae2f-48f3-a562-d2f6e640d8cf tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:19.725171 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a293600f-ae2f-48f3-a562-d2f6e640d8cf tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:19.725627 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a293600f-ae2f-48f3-a562-d2f6e640d8cf tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:19.726321 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a293600f-ae2f-48f3-a562-d2f6e640d8cf tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:19.726845 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a293600f-ae2f-48f3-a562-d2f6e640d8cf tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:19.727430 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a293600f-ae2f-48f3-a562-d2f6e640d8cf tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:19.862895 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-a293600f-ae2f-48f3-a562-d2f6e640d8cf tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:19.871198 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-a293600f-ae2f-48f3-a562-d2f6e640d8cf tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12" status: 200 len: 1367 microversion: 2.1 time: 0.157952 Aug 09 07:03:19.871903 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 79/147] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:19 2022] GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:20.230634 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-36919eca-8e37-43f4-8a0c-a3dfe57805ce tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:20.231242 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-36919eca-8e37-43f4-8a0c-a3dfe57805ce tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:20.238709 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-36919eca-8e37-43f4-8a0c-a3dfe57805ce tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:20.239193 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-36919eca-8e37-43f4-8a0c-a3dfe57805ce tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:20.239654 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-36919eca-8e37-43f4-8a0c-a3dfe57805ce tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:20.240349 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-36919eca-8e37-43f4-8a0c-a3dfe57805ce tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:20.240806 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-36919eca-8e37-43f4-8a0c-a3dfe57805ce tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:20.241479 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-36919eca-8e37-43f4-8a0c-a3dfe57805ce tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:20.379839 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-36919eca-8e37-43f4-8a0c-a3dfe57805ce tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:20.388128 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-36919eca-8e37-43f4-8a0c-a3dfe57805ce tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 200 len: 1521 microversion: 2.1 time: 0.161634 Aug 09 07:03:20.388866 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 69/148] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:20 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:20.602211 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b46a5b49-2942-46c6-9502-59b9cb4690ff tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:20.602810 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b46a5b49-2942-46c6-9502-59b9cb4690ff tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:20.608760 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b46a5b49-2942-46c6-9502-59b9cb4690ff tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:20.609234 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b46a5b49-2942-46c6-9502-59b9cb4690ff tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:20.609663 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b46a5b49-2942-46c6-9502-59b9cb4690ff tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:20.610337 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b46a5b49-2942-46c6-9502-59b9cb4690ff tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:20.610846 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b46a5b49-2942-46c6-9502-59b9cb4690ff tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:20.611262 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b46a5b49-2942-46c6-9502-59b9cb4690ff tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:20.629057 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-14723dfb-86c3-446f-b0b8-cb85a86aab6b tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:20.630214 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-14723dfb-86c3-446f-b0b8-cb85a86aab6b tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:20.637268 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-14723dfb-86c3-446f-b0b8-cb85a86aab6b tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:20.637754 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-14723dfb-86c3-446f-b0b8-cb85a86aab6b tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:20.638347 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-14723dfb-86c3-446f-b0b8-cb85a86aab6b tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:20.639221 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-14723dfb-86c3-446f-b0b8-cb85a86aab6b tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:20.639704 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-14723dfb-86c3-446f-b0b8-cb85a86aab6b tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:20.640245 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-14723dfb-86c3-446f-b0b8-cb85a86aab6b tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:20.809574 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b46a5b49-2942-46c6-9502-59b9cb4690ff tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:20.816842 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-14723dfb-86c3-446f-b0b8-cb85a86aab6b tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:20.818225 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b46a5b49-2942-46c6-9502-59b9cb4690ff tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:20.819790 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b46a5b49-2942-46c6-9502-59b9cb4690ff tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:20.821423 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b46a5b49-2942-46c6-9502-59b9cb4690ff tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1406 microversion: 2.20 time: 0.223132 Aug 09 07:03:20.821974 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 80/149] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:03:20 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1406 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:03:20.826827 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-14723dfb-86c3-446f-b0b8-cb85a86aab6b tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1363 microversion: 2.1 time: 0.201632 Aug 09 07:03:20.827464 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 70/150] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:20 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1363 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:03:20.892504 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2b77a039-5765-4363-b6cb-ac584453215d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:20.893102 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-2b77a039-5765-4363-b6cb-ac584453215d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: 66d40f73-633e-4564-a6d4-732cd15dcb12] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:20.899545 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2b77a039-5765-4363-b6cb-ac584453215d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:20.900184 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2b77a039-5765-4363-b6cb-ac584453215d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:20.900616 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2b77a039-5765-4363-b6cb-ac584453215d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:20.901331 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2b77a039-5765-4363-b6cb-ac584453215d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:20.901777 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2b77a039-5765-4363-b6cb-ac584453215d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:20.902194 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2b77a039-5765-4363-b6cb-ac584453215d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:21.073789 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2b77a039-5765-4363-b6cb-ac584453215d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:21.082756 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-2b77a039-5765-4363-b6cb-ac584453215d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12" status: 200 len: 1367 microversion: 2.1 time: 0.193331 Aug 09 07:03:21.083858 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 81/151] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:20 2022] GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12 => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:21.409661 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-549b7b31-806b-4114-a1a1-643b4f7843a9 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:21.410406 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-549b7b31-806b-4114-a1a1-643b4f7843a9 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:21.417243 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-549b7b31-806b-4114-a1a1-643b4f7843a9 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:21.417743 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-549b7b31-806b-4114-a1a1-643b4f7843a9 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:21.418171 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-549b7b31-806b-4114-a1a1-643b4f7843a9 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:21.418859 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-549b7b31-806b-4114-a1a1-643b4f7843a9 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:21.419302 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-549b7b31-806b-4114-a1a1-643b4f7843a9 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:21.419749 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-549b7b31-806b-4114-a1a1-643b4f7843a9 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:21.568721 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-549b7b31-806b-4114-a1a1-643b4f7843a9 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:21.577865 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-549b7b31-806b-4114-a1a1-643b4f7843a9 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 200 len: 1521 microversion: 2.1 time: 0.171901 Aug 09 07:03:21.578484 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 71/152] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:21 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:21.848994 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-bb2136eb-2b6c-41a2-ae66-ebcaa24a4d14 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:21.849571 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-77f43d8e-88de-4cf7-b099-5a7cbdc865cb tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:21.850178 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-77f43d8e-88de-4cf7-b099-5a7cbdc865cb tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:21.852523 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-bb2136eb-2b6c-41a2-ae66-ebcaa24a4d14 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:21.857301 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-77f43d8e-88de-4cf7-b099-5a7cbdc865cb tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:21.857822 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-77f43d8e-88de-4cf7-b099-5a7cbdc865cb tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:21.858258 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-77f43d8e-88de-4cf7-b099-5a7cbdc865cb tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:21.858953 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-77f43d8e-88de-4cf7-b099-5a7cbdc865cb tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:21.859399 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-77f43d8e-88de-4cf7-b099-5a7cbdc865cb tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:21.860000 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-77f43d8e-88de-4cf7-b099-5a7cbdc865cb tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:21.868344 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bb2136eb-2b6c-41a2-ae66-ebcaa24a4d14 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:21.868906 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bb2136eb-2b6c-41a2-ae66-ebcaa24a4d14 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:21.869484 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bb2136eb-2b6c-41a2-ae66-ebcaa24a4d14 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:21.870474 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bb2136eb-2b6c-41a2-ae66-ebcaa24a4d14 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:21.870994 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bb2136eb-2b6c-41a2-ae66-ebcaa24a4d14 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:21.871479 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bb2136eb-2b6c-41a2-ae66-ebcaa24a4d14 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:22.069219 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-77f43d8e-88de-4cf7-b099-5a7cbdc865cb tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:22.076253 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-bb2136eb-2b6c-41a2-ae66-ebcaa24a4d14 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:22.084035 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-77f43d8e-88de-4cf7-b099-5a7cbdc865cb tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1363 microversion: 2.1 time: 0.238436 Aug 09 07:03:22.084787 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-bb2136eb-2b6c-41a2-ae66-ebcaa24a4d14 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:22.084921 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 72/153] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:21 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1363 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:03:22.086890 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-bb2136eb-2b6c-41a2-ae66-ebcaa24a4d14 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:22.088044 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-bb2136eb-2b6c-41a2-ae66-ebcaa24a4d14 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1406 microversion: 2.20 time: 0.242831 Aug 09 07:03:22.094917 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 82/154] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:03:21 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1406 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:03:22.111862 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-cd520fba-d1cf-48d2-b028-a016abfe53b1 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:22.112483 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-cd520fba-d1cf-48d2-b028-a016abfe53b1 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: 66d40f73-633e-4564-a6d4-732cd15dcb12] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:22.119843 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cd520fba-d1cf-48d2-b028-a016abfe53b1 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:22.119843 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cd520fba-d1cf-48d2-b028-a016abfe53b1 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:22.120044 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cd520fba-d1cf-48d2-b028-a016abfe53b1 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:22.120784 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cd520fba-d1cf-48d2-b028-a016abfe53b1 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:22.121238 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cd520fba-d1cf-48d2-b028-a016abfe53b1 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:22.121693 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cd520fba-d1cf-48d2-b028-a016abfe53b1 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:22.277833 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-cd520fba-d1cf-48d2-b028-a016abfe53b1 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:22.285965 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-cd520fba-d1cf-48d2-b028-a016abfe53b1 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12" status: 200 len: 1367 microversion: 2.1 time: 0.185157 Aug 09 07:03:22.286622 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 73/155] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:22 2022] GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12 => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:03:22.600870 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-04be88e8-19ed-4310-947e-02e6c33a95d2 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:22.601624 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-04be88e8-19ed-4310-947e-02e6c33a95d2 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:22.608195 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-04be88e8-19ed-4310-947e-02e6c33a95d2 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:22.608669 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-04be88e8-19ed-4310-947e-02e6c33a95d2 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:22.609176 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-04be88e8-19ed-4310-947e-02e6c33a95d2 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:22.609903 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-04be88e8-19ed-4310-947e-02e6c33a95d2 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:22.610337 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-04be88e8-19ed-4310-947e-02e6c33a95d2 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:22.610816 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-04be88e8-19ed-4310-947e-02e6c33a95d2 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:22.772532 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-04be88e8-19ed-4310-947e-02e6c33a95d2 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:22.780182 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-04be88e8-19ed-4310-947e-02e6c33a95d2 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 200 len: 1521 microversion: 2.1 time: 0.183443 Aug 09 07:03:22.780755 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 83/156] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:22 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:23.106126 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-6345df72-48a9-4020-aeaf-960fb12581b9 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:23.106745 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-6345df72-48a9-4020-aeaf-960fb12581b9 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:23.108737 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_api:SELECT=100 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:23.111096 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-11e57294-ea57-47fd-b6f6-c93534f8f7f5 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:23.111756 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-11e57294-ea57-47fd-b6f6-c93534f8f7f5 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:23.114017 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6345df72-48a9-4020-aeaf-960fb12581b9 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:23.114831 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6345df72-48a9-4020-aeaf-960fb12581b9 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:23.115434 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6345df72-48a9-4020-aeaf-960fb12581b9 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:23.116309 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6345df72-48a9-4020-aeaf-960fb12581b9 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:23.116754 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6345df72-48a9-4020-aeaf-960fb12581b9 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:23.118072 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6345df72-48a9-4020-aeaf-960fb12581b9 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:23.119893 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-11e57294-ea57-47fd-b6f6-c93534f8f7f5 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:23.120660 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-11e57294-ea57-47fd-b6f6-c93534f8f7f5 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:23.121308 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-11e57294-ea57-47fd-b6f6-c93534f8f7f5 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:23.122571 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-11e57294-ea57-47fd-b6f6-c93534f8f7f5 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:23.123229 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-11e57294-ea57-47fd-b6f6-c93534f8f7f5 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:23.123697 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-11e57294-ea57-47fd-b6f6-c93534f8f7f5 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:23.128082 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=100 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:23.366583 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-6345df72-48a9-4020-aeaf-960fb12581b9 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:23.374218 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-6345df72-48a9-4020-aeaf-960fb12581b9 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1363 microversion: 2.1 time: 0.272434 Aug 09 07:03:23.374875 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 74/157] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:23 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1363 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:23.377575 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-11e57294-ea57-47fd-b6f6-c93534f8f7f5 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:23.387191 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-11e57294-ea57-47fd-b6f6-c93534f8f7f5 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:23.389672 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-11e57294-ea57-47fd-b6f6-c93534f8f7f5 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:23.390842 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-11e57294-ea57-47fd-b6f6-c93534f8f7f5 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1406 microversion: 2.20 time: 0.284308 Aug 09 07:03:23.391401 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 84/158] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:03:23 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1406 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 07:03:23.392345 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-9291ee6a-23eb-4b82-ad1d-37114a3881c5 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:23.392967 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-9291ee6a-23eb-4b82-ad1d-37114a3881c5 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: 66d40f73-633e-4564-a6d4-732cd15dcb12] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:23.400046 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9291ee6a-23eb-4b82-ad1d-37114a3881c5 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:23.400717 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9291ee6a-23eb-4b82-ad1d-37114a3881c5 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:23.401157 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9291ee6a-23eb-4b82-ad1d-37114a3881c5 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:23.401850 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9291ee6a-23eb-4b82-ad1d-37114a3881c5 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:23.402304 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9291ee6a-23eb-4b82-ad1d-37114a3881c5 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:23.402731 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9291ee6a-23eb-4b82-ad1d-37114a3881c5 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:23.562136 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-9291ee6a-23eb-4b82-ad1d-37114a3881c5 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:23.571930 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-9291ee6a-23eb-4b82-ad1d-37114a3881c5 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12" status: 200 len: 1367 microversion: 2.1 time: 0.195624 Aug 09 07:03:23.572520 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 75/159] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:23 2022] GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12 => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:23.800707 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c3ff04ab-e8cb-4ba9-995b-af40d3251d06 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:23.801736 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c3ff04ab-e8cb-4ba9-995b-af40d3251d06 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:23.807932 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c3ff04ab-e8cb-4ba9-995b-af40d3251d06 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:23.808492 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c3ff04ab-e8cb-4ba9-995b-af40d3251d06 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:23.809007 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c3ff04ab-e8cb-4ba9-995b-af40d3251d06 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:23.809765 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c3ff04ab-e8cb-4ba9-995b-af40d3251d06 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:23.810294 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c3ff04ab-e8cb-4ba9-995b-af40d3251d06 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:23.810790 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c3ff04ab-e8cb-4ba9-995b-af40d3251d06 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:23.981789 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c3ff04ab-e8cb-4ba9-995b-af40d3251d06 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:23.989986 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c3ff04ab-e8cb-4ba9-995b-af40d3251d06 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 200 len: 1521 microversion: 2.1 time: 0.193070 Aug 09 07:03:23.990769 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 85/160] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:23 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:24.404683 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-03c00a23-a496-430e-8cbd-16810f30cb08 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:24.405438 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-03c00a23-a496-430e-8cbd-16810f30cb08 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:24.412546 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-03c00a23-a496-430e-8cbd-16810f30cb08 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:24.413032 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-03c00a23-a496-430e-8cbd-16810f30cb08 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:24.413535 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-03c00a23-a496-430e-8cbd-16810f30cb08 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:24.414979 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-03c00a23-a496-430e-8cbd-16810f30cb08 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:24.415852 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-03c00a23-a496-430e-8cbd-16810f30cb08 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:24.416428 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-03c00a23-a496-430e-8cbd-16810f30cb08 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:24.419025 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b544b6d3-94f0-47c5-b66c-2a53cb087cf6 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:24.420077 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b544b6d3-94f0-47c5-b66c-2a53cb087cf6 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:24.439534 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b544b6d3-94f0-47c5-b66c-2a53cb087cf6 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:24.440050 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b544b6d3-94f0-47c5-b66c-2a53cb087cf6 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:24.441003 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b544b6d3-94f0-47c5-b66c-2a53cb087cf6 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:24.444366 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b544b6d3-94f0-47c5-b66c-2a53cb087cf6 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:24.445332 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b544b6d3-94f0-47c5-b66c-2a53cb087cf6 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:24.447001 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b544b6d3-94f0-47c5-b66c-2a53cb087cf6 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:24.646413 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-03c00a23-a496-430e-8cbd-16810f30cb08 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:24.666118 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-03c00a23-a496-430e-8cbd-16810f30cb08 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1363 microversion: 2.1 time: 0.264889 Aug 09 07:03:24.675132 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b544b6d3-94f0-47c5-b66c-2a53cb087cf6 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:24.678995 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 76/161] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:24 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1363 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:24.685810 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b544b6d3-94f0-47c5-b66c-2a53cb087cf6 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:24.687580 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b544b6d3-94f0-47c5-b66c-2a53cb087cf6 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:24.689110 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b544b6d3-94f0-47c5-b66c-2a53cb087cf6 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1406 microversion: 2.20 time: 0.278434 Aug 09 07:03:24.689899 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 86/162] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:03:24 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1406 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:03:24.691615 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-1321c2a0-1aba-4fa7-8705-7d17cd1f2c6b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:24.694525 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-1321c2a0-1aba-4fa7-8705-7d17cd1f2c6b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: 66d40f73-633e-4564-a6d4-732cd15dcb12] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:24.707048 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1321c2a0-1aba-4fa7-8705-7d17cd1f2c6b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:24.707541 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1321c2a0-1aba-4fa7-8705-7d17cd1f2c6b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:24.708004 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1321c2a0-1aba-4fa7-8705-7d17cd1f2c6b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:24.708708 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1321c2a0-1aba-4fa7-8705-7d17cd1f2c6b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:24.709158 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1321c2a0-1aba-4fa7-8705-7d17cd1f2c6b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:24.709578 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1321c2a0-1aba-4fa7-8705-7d17cd1f2c6b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:24.774309 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-95b4db70-57dd-449c-b171-e5b4f3df54b7 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fa8ab713-85d5-47cf-8a11-75d01ba283de"}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:03:24.776863 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-95b4db70-57dd-449c-b171-e5b4f3df54b7 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] [instance: 9883f029-68a3-4946-b14b-47721b72f3db] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:24.789462 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-95b4db70-57dd-449c-b171-e5b4f3df54b7 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:24.790428 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-95b4db70-57dd-449c-b171-e5b4f3df54b7 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:24.793238 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-95b4db70-57dd-449c-b171-e5b4f3df54b7 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:24.794696 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-95b4db70-57dd-449c-b171-e5b4f3df54b7 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:24.795693 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-95b4db70-57dd-449c-b171-e5b4f3df54b7 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:24.796806 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-95b4db70-57dd-449c-b171-e5b4f3df54b7 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:24.882548 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-1321c2a0-1aba-4fa7-8705-7d17cd1f2c6b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:24.891851 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-1321c2a0-1aba-4fa7-8705-7d17cd1f2c6b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12" status: 200 len: 1367 microversion: 2.1 time: 0.210206 Aug 09 07:03:24.892654 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 77/163] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:24 2022] GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12 => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:25.012951 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-e4a220ff-fa45-4092-b4a7-e632a0669f78 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:25.013671 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-e4a220ff-fa45-4092-b4a7-e632a0669f78 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:25.019937 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e4a220ff-fa45-4092-b4a7-e632a0669f78 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:25.020494 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e4a220ff-fa45-4092-b4a7-e632a0669f78 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:25.021022 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e4a220ff-fa45-4092-b4a7-e632a0669f78 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:25.021778 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e4a220ff-fa45-4092-b4a7-e632a0669f78 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:25.022305 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e4a220ff-fa45-4092-b4a7-e632a0669f78 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:25.022800 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e4a220ff-fa45-4092-b4a7-e632a0669f78 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:25.157654 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-e4a220ff-fa45-4092-b4a7-e632a0669f78 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:25.166888 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-e4a220ff-fa45-4092-b4a7-e632a0669f78 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 200 len: 1521 microversion: 2.1 time: 0.157657 Aug 09 07:03:25.167690 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 78/164] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:25 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:25.704420 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-4fd1ef12-379a-4957-a6aa-4a546019e62e tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:25.705656 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-4fd1ef12-379a-4957-a6aa-4a546019e62e tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:25.712939 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4fd1ef12-379a-4957-a6aa-4a546019e62e tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:25.713436 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4fd1ef12-379a-4957-a6aa-4a546019e62e tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:25.713873 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4fd1ef12-379a-4957-a6aa-4a546019e62e tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:25.714682 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4fd1ef12-379a-4957-a6aa-4a546019e62e tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:25.715019 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4fd1ef12-379a-4957-a6aa-4a546019e62e tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:25.715446 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4fd1ef12-379a-4957-a6aa-4a546019e62e tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:25.876862 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-4fd1ef12-379a-4957-a6aa-4a546019e62e tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:25.886434 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-4fd1ef12-379a-4957-a6aa-4a546019e62e tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1363 microversion: 2.1 time: 0.187505 Aug 09 07:03:25.887097 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 79/165] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:25 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:03:25.891954 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-efba31ca-ba94-40b1-a8a0-583f540d9b79 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:25.892555 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-efba31ca-ba94-40b1-a8a0-583f540d9b79 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:25.898591 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-efba31ca-ba94-40b1-a8a0-583f540d9b79 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:25.899488 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-efba31ca-ba94-40b1-a8a0-583f540d9b79 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:25.900113 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-efba31ca-ba94-40b1-a8a0-583f540d9b79 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:25.900960 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-efba31ca-ba94-40b1-a8a0-583f540d9b79 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:25.901715 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-efba31ca-ba94-40b1-a8a0-583f540d9b79 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:25.902268 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-efba31ca-ba94-40b1-a8a0-583f540d9b79 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:26.170987 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-efba31ca-ba94-40b1-a8a0-583f540d9b79 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:26.187441 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-efba31ca-ba94-40b1-a8a0-583f540d9b79 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:26.189245 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-efba31ca-ba94-40b1-a8a0-583f540d9b79 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:26.190838 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-efba31ca-ba94-40b1-a8a0-583f540d9b79 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1406 microversion: 2.20 time: 0.301986 Aug 09 07:03:26.191407 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 80/166] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:03:25 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1406 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:03:26.200108 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-2c8245c2-1b37-4664-b5f0-f0b46e893ea6 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:26.206439 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-2c8245c2-1b37-4664-b5f0-f0b46e893ea6 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: 66d40f73-633e-4564-a6d4-732cd15dcb12] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:26.219081 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2c8245c2-1b37-4664-b5f0-f0b46e893ea6 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:26.221141 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2c8245c2-1b37-4664-b5f0-f0b46e893ea6 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:26.223515 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2c8245c2-1b37-4664-b5f0-f0b46e893ea6 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:26.224745 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2c8245c2-1b37-4664-b5f0-f0b46e893ea6 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:26.225516 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2c8245c2-1b37-4664-b5f0-f0b46e893ea6 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:26.226257 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2c8245c2-1b37-4664-b5f0-f0b46e893ea6 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:26.420217 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-95b4db70-57dd-449c-b171-e5b4f3df54b7 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] 10.222.0.30 "POST /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.649546 Aug 09 07:03:26.426388 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 87/167] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Aug 9 07:03:24 2022] POST /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db/os-volume_attachments => generated 194 bytes in 1652 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:03:26.438466 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-9e024b63-9615-48c8-95cc-c931ecc389cf tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:26.446332 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-9e024b63-9615-48c8-95cc-c931ecc389cf tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:26.460316 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9e024b63-9615-48c8-95cc-c931ecc389cf tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:26.461035 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9e024b63-9615-48c8-95cc-c931ecc389cf tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:26.461708 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9e024b63-9615-48c8-95cc-c931ecc389cf tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:26.462600 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9e024b63-9615-48c8-95cc-c931ecc389cf tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:26.463473 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9e024b63-9615-48c8-95cc-c931ecc389cf tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:26.464191 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9e024b63-9615-48c8-95cc-c931ecc389cf tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:26.500312 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-2c8245c2-1b37-4664-b5f0-f0b46e893ea6 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:26.536627 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-2c8245c2-1b37-4664-b5f0-f0b46e893ea6 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12" status: 200 len: 1557 microversion: 2.1 time: 0.344044 Aug 09 07:03:26.538534 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 81/168] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:26 2022] GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12 => generated 1557 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:26.545426 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [req-21e24805-8241-46c9-a933-7bfd1e31df19 req-0ec0b518-7a21-4612-b19b-430e47f1d267 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2236b6b2-39b4-4b81-bb86-006774babc2e", "name": "network-vif-plugged", "status": "completed", "tag": "ada64d06-0764-4487-9425-780bad419035"}]} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:03:26.591081 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-21e24805-8241-46c9-a933-7bfd1e31df19 req-0ec0b518-7a21-4612-b19b-430e47f1d267 service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:26.594091 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-21e24805-8241-46c9-a933-7bfd1e31df19 req-0ec0b518-7a21-4612-b19b-430e47f1d267 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:26.595730 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-21e24805-8241-46c9-a933-7bfd1e31df19 req-0ec0b518-7a21-4612-b19b-430e47f1d267 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:26.635648 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.compute.server_external_events [req-21e24805-8241-46c9-a933-7bfd1e31df19 req-0ec0b518-7a21-4612-b19b-430e47f1d267 service nova] Creating event network-vif-plugged:ada64d06-0764-4487-9425-780bad419035 for instance 2236b6b2-39b4-4b81-bb86-006774babc2e on hv-cinder-85251 Aug 09 07:03:26.645134 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [req-21e24805-8241-46c9-a933-7bfd1e31df19 req-0ec0b518-7a21-4612-b19b-430e47f1d267 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104460 Aug 09 07:03:26.646541 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 82/169] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:03:26.653025 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-6bb7fb2a-ab66-4ad2-ab99-2d4b6574d07b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:26.654628 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-6bb7fb2a-ab66-4ad2-ab99-2d4b6574d07b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: 66d40f73-633e-4564-a6d4-732cd15dcb12] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:26.662199 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6bb7fb2a-ab66-4ad2-ab99-2d4b6574d07b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:26.663151 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6bb7fb2a-ab66-4ad2-ab99-2d4b6574d07b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:26.663803 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6bb7fb2a-ab66-4ad2-ab99-2d4b6574d07b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:26.665314 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6bb7fb2a-ab66-4ad2-ab99-2d4b6574d07b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:26.666086 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6bb7fb2a-ab66-4ad2-ab99-2d4b6574d07b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:26.667165 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6bb7fb2a-ab66-4ad2-ab99-2d4b6574d07b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:26.837497 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-6bb7fb2a-ab66-4ad2-ab99-2d4b6574d07b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.188938 Aug 09 07:03:26.839135 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 83/170] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Aug 9 07:03:26 2022] GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12/os-interface => generated 284 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:03:26.906526 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-b239cf4c-db2e-422b-b9df-a72b0d5aab1d tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:26.907131 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-b239cf4c-db2e-422b-b9df-a72b0d5aab1d tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:26.924370 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b239cf4c-db2e-422b-b9df-a72b0d5aab1d tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:26.924886 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b239cf4c-db2e-422b-b9df-a72b0d5aab1d tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:26.925325 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b239cf4c-db2e-422b-b9df-a72b0d5aab1d tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:26.926024 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b239cf4c-db2e-422b-b9df-a72b0d5aab1d tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:26.926472 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b239cf4c-db2e-422b-b9df-a72b0d5aab1d tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:26.926895 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b239cf4c-db2e-422b-b9df-a72b0d5aab1d tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:27.018289 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-9e024b63-9615-48c8-95cc-c931ecc389cf tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:27.037860 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-9e024b63-9615-48c8-95cc-c931ecc389cf tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 200 len: 1521 microversion: 2.1 time: 0.609818 Aug 09 07:03:27.045580 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 88/171] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:26 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 1521 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:27.196757 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-b239cf4c-db2e-422b-b9df-a72b0d5aab1d tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:27.213566 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-b239cf4c-db2e-422b-b9df-a72b0d5aab1d tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1363 microversion: 2.1 time: 0.310951 Aug 09 07:03:27.214420 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 84/172] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:26 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1363 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:03:27.216714 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-5777f9ef-4e0d-4998-bbc0-579df147e3f5 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:27.217755 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-5777f9ef-4e0d-4998-bbc0-579df147e3f5 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:27.233717 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5777f9ef-4e0d-4998-bbc0-579df147e3f5 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:27.235928 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5777f9ef-4e0d-4998-bbc0-579df147e3f5 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:27.236658 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5777f9ef-4e0d-4998-bbc0-579df147e3f5 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:27.237701 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5777f9ef-4e0d-4998-bbc0-579df147e3f5 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:27.238401 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5777f9ef-4e0d-4998-bbc0-579df147e3f5 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:27.239001 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5777f9ef-4e0d-4998-bbc0-579df147e3f5 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:27.437696 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-5777f9ef-4e0d-4998-bbc0-579df147e3f5 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:27.449026 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-5777f9ef-4e0d-4998-bbc0-579df147e3f5 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:27.450523 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-5777f9ef-4e0d-4998-bbc0-579df147e3f5 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:27.451669 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-5777f9ef-4e0d-4998-bbc0-579df147e3f5 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1406 microversion: 2.20 time: 0.241361 Aug 09 07:03:27.452461 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 89/173] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:03:27 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1406 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 07:03:28.068624 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-cca70454-1fd9-4e85-badc-720fd0927c53 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:28.069233 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-cca70454-1fd9-4e85-badc-720fd0927c53 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:28.077302 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cca70454-1fd9-4e85-badc-720fd0927c53 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:28.077870 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cca70454-1fd9-4e85-badc-720fd0927c53 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:28.078378 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cca70454-1fd9-4e85-badc-720fd0927c53 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:28.079802 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cca70454-1fd9-4e85-badc-720fd0927c53 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:28.080619 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cca70454-1fd9-4e85-badc-720fd0927c53 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:28.081307 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cca70454-1fd9-4e85-badc-720fd0927c53 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:28.234340 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f96baacf-6eea-4a2e-a8e6-53b520fc7dea tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:28.234953 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-f96baacf-6eea-4a2e-a8e6-53b520fc7dea tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:28.241645 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f96baacf-6eea-4a2e-a8e6-53b520fc7dea tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:28.242897 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f96baacf-6eea-4a2e-a8e6-53b520fc7dea tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:28.243540 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f96baacf-6eea-4a2e-a8e6-53b520fc7dea tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:28.244489 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f96baacf-6eea-4a2e-a8e6-53b520fc7dea tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:28.245156 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f96baacf-6eea-4a2e-a8e6-53b520fc7dea tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:28.245882 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f96baacf-6eea-4a2e-a8e6-53b520fc7dea tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:28.650183 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-cca70454-1fd9-4e85-badc-720fd0927c53 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:28.660735 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-f96baacf-6eea-4a2e-a8e6-53b520fc7dea tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:28.682234 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-cca70454-1fd9-4e85-badc-720fd0927c53 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 200 len: 1521 microversion: 2.1 time: 0.617305 Aug 09 07:03:28.682810 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 85/174] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:28 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 1521 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:28.685156 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f96baacf-6eea-4a2e-a8e6-53b520fc7dea tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1363 microversion: 2.1 time: 0.454566 Aug 09 07:03:28.685731 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 90/175] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:28 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1363 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:03:28.703028 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-aa902311-18f0-48fc-b73f-0952d35ac527 req-465dd9d4-8d62-4fe2-a2c8-e8c4010d1d52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66d40f73-633e-4564-a6d4-732cd15dcb12", "tag": "6a17b65c-bc72-41ab-af44-8de8ed744b45"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:03:28.703696 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-b8f01d97-a6b8-441c-a325-18acd703bab7 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:28.704378 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-b8f01d97-a6b8-441c-a325-18acd703bab7 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:28.711527 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b8f01d97-a6b8-441c-a325-18acd703bab7 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:28.712396 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b8f01d97-a6b8-441c-a325-18acd703bab7 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:28.712980 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b8f01d97-a6b8-441c-a325-18acd703bab7 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:28.713832 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b8f01d97-a6b8-441c-a325-18acd703bab7 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:28.714431 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b8f01d97-a6b8-441c-a325-18acd703bab7 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:28.715055 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b8f01d97-a6b8-441c-a325-18acd703bab7 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:28.719793 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-aa902311-18f0-48fc-b73f-0952d35ac527 req-465dd9d4-8d62-4fe2-a2c8-e8c4010d1d52 service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:28.720294 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_cell1:SELECT=100 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:28.720743 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-aa902311-18f0-48fc-b73f-0952d35ac527 req-465dd9d4-8d62-4fe2-a2c8-e8c4010d1d52 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:28.721356 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-aa902311-18f0-48fc-b73f-0952d35ac527 req-465dd9d4-8d62-4fe2-a2c8-e8c4010d1d52 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:28.746127 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-aa902311-18f0-48fc-b73f-0952d35ac527 req-465dd9d4-8d62-4fe2-a2c8-e8c4010d1d52 service nova] Creating event network-changed:6a17b65c-bc72-41ab-af44-8de8ed744b45 for instance 66d40f73-633e-4564-a6d4-732cd15dcb12 on hv-cinder-85251 Aug 09 07:03:28.752421 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-aa902311-18f0-48fc-b73f-0952d35ac527 req-465dd9d4-8d62-4fe2-a2c8-e8c4010d1d52 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065176 Aug 09 07:03:28.753694 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 91/176] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:03:28.836412 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-7baf76af-585d-4fde-a1f1-0df13f2cc4a6 req-56a36dbe-dea2-4f75-a355-72c48a941223 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46", "name": "network-vif-plugged", "status": "completed", "tag": "8ca46829-e122-42ef-87e0-c5d0bd4f1294"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:03:28.858427 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-7baf76af-585d-4fde-a1f1-0df13f2cc4a6 req-56a36dbe-dea2-4f75-a355-72c48a941223 service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:28.859669 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-7baf76af-585d-4fde-a1f1-0df13f2cc4a6 req-56a36dbe-dea2-4f75-a355-72c48a941223 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:28.861129 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-7baf76af-585d-4fde-a1f1-0df13f2cc4a6 req-56a36dbe-dea2-4f75-a355-72c48a941223 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:28.930087 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-7baf76af-585d-4fde-a1f1-0df13f2cc4a6 req-56a36dbe-dea2-4f75-a355-72c48a941223 service nova] Creating event network-vif-plugged:8ca46829-e122-42ef-87e0-c5d0bd4f1294 for instance 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 on hv-cinder-85251 Aug 09 07:03:28.938681 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-7baf76af-585d-4fde-a1f1-0df13f2cc4a6 req-56a36dbe-dea2-4f75-a355-72c48a941223 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103197 Aug 09 07:03:28.939520 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 92/177] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 07:03:28.979147 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-b8f01d97-a6b8-441c-a325-18acd703bab7 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:28.987702 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-b8f01d97-a6b8-441c-a325-18acd703bab7 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:28.990576 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-b8f01d97-a6b8-441c-a325-18acd703bab7 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:28.992519 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-b8f01d97-a6b8-441c-a325-18acd703bab7 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1406 microversion: 2.20 time: 0.307073 Aug 09 07:03:28.993881 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 86/178] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:03:28 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1406 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:03:29.706708 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-392887c1-f3ef-48be-8691-313ee0c2b817 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:29.708152 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-392887c1-f3ef-48be-8691-313ee0c2b817 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:29.708478 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-f05d5f9e-1e4a-41b6-8d5f-51be047d8928 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:29.709099 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-f05d5f9e-1e4a-41b6-8d5f-51be047d8928 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:29.713414 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=100 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:29.718100 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-392887c1-f3ef-48be-8691-313ee0c2b817 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:29.718840 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-392887c1-f3ef-48be-8691-313ee0c2b817 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:29.719503 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-392887c1-f3ef-48be-8691-313ee0c2b817 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:29.719659 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f05d5f9e-1e4a-41b6-8d5f-51be047d8928 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:29.720215 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f05d5f9e-1e4a-41b6-8d5f-51be047d8928 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:29.720658 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f05d5f9e-1e4a-41b6-8d5f-51be047d8928 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:29.721022 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-392887c1-f3ef-48be-8691-313ee0c2b817 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:29.721424 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f05d5f9e-1e4a-41b6-8d5f-51be047d8928 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:29.721882 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f05d5f9e-1e4a-41b6-8d5f-51be047d8928 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:29.721989 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-392887c1-f3ef-48be-8691-313ee0c2b817 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:29.722563 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f05d5f9e-1e4a-41b6-8d5f-51be047d8928 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:29.722830 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-392887c1-f3ef-48be-8691-313ee0c2b817 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:29.975529 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-392887c1-f3ef-48be-8691-313ee0c2b817 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:29.984873 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-392887c1-f3ef-48be-8691-313ee0c2b817 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 200 len: 1521 microversion: 2.1 time: 0.282088 Aug 09 07:03:29.985666 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 93/179] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:29 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 1521 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:30.003138 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-f05d5f9e-1e4a-41b6-8d5f-51be047d8928 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:30.015422 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-f05d5f9e-1e4a-41b6-8d5f-51be047d8928 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1363 microversion: 2.1 time: 0.312273 Aug 09 07:03:30.016514 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 87/180] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:29 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1363 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:03:30.032494 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d9efaf7c-5dac-4cba-91f1-7d6f5308ba23 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:30.033205 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-d9efaf7c-5dac-4cba-91f1-7d6f5308ba23 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:30.040847 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d9efaf7c-5dac-4cba-91f1-7d6f5308ba23 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:30.041484 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d9efaf7c-5dac-4cba-91f1-7d6f5308ba23 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:30.042024 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d9efaf7c-5dac-4cba-91f1-7d6f5308ba23 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:30.042844 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d9efaf7c-5dac-4cba-91f1-7d6f5308ba23 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:30.043375 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d9efaf7c-5dac-4cba-91f1-7d6f5308ba23 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:30.043920 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d9efaf7c-5dac-4cba-91f1-7d6f5308ba23 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:30.191677 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d9efaf7c-5dac-4cba-91f1-7d6f5308ba23 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:30.200514 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d9efaf7c-5dac-4cba-91f1-7d6f5308ba23 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:30.202230 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d9efaf7c-5dac-4cba-91f1-7d6f5308ba23 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:30.203380 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-d9efaf7c-5dac-4cba-91f1-7d6f5308ba23 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1597 microversion: 2.20 time: 0.175380 Aug 09 07:03:30.203985 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 94/181] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:03:30 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1597 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:03:30.225540 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-fa825ba7-1fb5-4640-8e6d-1b8148e05b80 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:30.226026 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-fa825ba7-1fb5-4640-8e6d-1b8148e05b80 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:30.231854 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-fa825ba7-1fb5-4640-8e6d-1b8148e05b80 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:30.232399 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-fa825ba7-1fb5-4640-8e6d-1b8148e05b80 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:30.232832 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-fa825ba7-1fb5-4640-8e6d-1b8148e05b80 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:30.233561 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-fa825ba7-1fb5-4640-8e6d-1b8148e05b80 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:30.234150 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-fa825ba7-1fb5-4640-8e6d-1b8148e05b80 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:30.234571 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-fa825ba7-1fb5-4640-8e6d-1b8148e05b80 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:30.316746 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-fa825ba7-1fb5-4640-8e6d-1b8148e05b80 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.094898 Aug 09 07:03:30.325537 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 88/182] 10.222.0.30 () {60 vars in 1316 bytes} [Tue Aug 9 07:03:30 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 07:03:30.663540 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-3d616903-d755-4090-8ff3-942723667bae tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1943775220", "imageRef": "5d2c35cc-2f3b-4a22-bd68-79c71882b6a2", "flavorRef": "452", "networks": [{"uuid": "b93714ab-dd44-4cef-b08e-bf9e4354d84a"}]}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:03:30.736114 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.network.neutron [None req-3d616903-d755-4090-8ff3-942723667bae tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] validate_networks() for [('b93714ab-dd44-4cef-b08e-bf9e4354d84a', None, None, None, None, None)] {{(pid=117859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 07:03:31.014785 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-af8c5bf7-c1e2-45da-905e-6756dcf58902 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:31.015441 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-af8c5bf7-c1e2-45da-905e-6756dcf58902 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:31.021536 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-af8c5bf7-c1e2-45da-905e-6756dcf58902 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:31.021859 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-af8c5bf7-c1e2-45da-905e-6756dcf58902 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:31.022477 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-af8c5bf7-c1e2-45da-905e-6756dcf58902 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:31.023172 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-af8c5bf7-c1e2-45da-905e-6756dcf58902 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:31.023646 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-af8c5bf7-c1e2-45da-905e-6756dcf58902 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:31.024073 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-af8c5bf7-c1e2-45da-905e-6756dcf58902 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:31.411590 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-af8c5bf7-c1e2-45da-905e-6756dcf58902 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:31.419273 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-af8c5bf7-c1e2-45da-905e-6756dcf58902 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 200 len: 1521 microversion: 2.1 time: 0.408324 Aug 09 07:03:31.431783 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 89/183] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:31 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 1521 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:31.437351 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-74d57ddf-b2a0-4b7b-8e70-70b5acd2bcae tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:31.437966 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-74d57ddf-b2a0-4b7b-8e70-70b5acd2bcae tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:31.443788 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-74d57ddf-b2a0-4b7b-8e70-70b5acd2bcae tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:31.444267 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-74d57ddf-b2a0-4b7b-8e70-70b5acd2bcae tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:31.444693 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-74d57ddf-b2a0-4b7b-8e70-70b5acd2bcae tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:31.445928 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-74d57ddf-b2a0-4b7b-8e70-70b5acd2bcae tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:31.446333 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-74d57ddf-b2a0-4b7b-8e70-70b5acd2bcae tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:31.446755 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-74d57ddf-b2a0-4b7b-8e70-70b5acd2bcae tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:31.919121 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-3d616903-d755-4090-8ff3-942723667bae tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Flavor limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 07:03:31.919583 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-3d616903-d755-4090-8ff3-942723667bae tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Image limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 07:03:31.920148 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-3d616903-d755-4090-8ff3-942723667bae tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Flavor pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 07:03:31.920626 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-3d616903-d755-4090-8ff3-942723667bae tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Image pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 07:03:31.921107 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-3d616903-d755-4090-8ff3-942723667bae tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 07:03:31.930267 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3d616903-d755-4090-8ff3-942723667bae tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:31.930741 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3d616903-d755-4090-8ff3-942723667bae tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:31.931169 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3d616903-d755-4090-8ff3-942723667bae tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:31.931912 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3d616903-d755-4090-8ff3-942723667bae tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:31.932364 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3d616903-d755-4090-8ff3-942723667bae tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:31.932784 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3d616903-d755-4090-8ff3-942723667bae tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:31.941189 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-74d57ddf-b2a0-4b7b-8e70-70b5acd2bcae tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:31.950102 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-74d57ddf-b2a0-4b7b-8e70-70b5acd2bcae tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1363 microversion: 2.1 time: 0.517124 Aug 09 07:03:31.951027 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 90/184] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:31 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1363 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:31.956747 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-3d616903-d755-4090-8ff3-942723667bae tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Getting quotas for project 814c528dd56c4e61ae5cba5733bf2f08. Resources: {'cores', 'instances', 'ram'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 07:03:31.960740 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-3d616903-d755-4090-8ff3-942723667bae tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Getting quotas for user 2a6b55d7cb1840a5ad93369589a36596 and project 814c528dd56c4e61ae5cba5733bf2f08. Resources: {'cores', 'instances', 'ram'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 07:03:31.972823 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-3d616903-d755-4090-8ff3-942723667bae tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Going to run 1 instances... {{(pid=117859) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 07:03:31.975693 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-3d616903-d755-4090-8ff3-942723667bae tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] [instance: 7240387f-c724-4ecb-9c26-d58666857ddf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5d2c35cc-2f3b-4a22-bd68-79c71882b6a2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 07:03:32.034920 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-3d616903-d755-4090-8ff3-942723667bae tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.375867 Aug 09 07:03:32.036142 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 95/185] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 9 07:03:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1379 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 07:03:32.048176 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-ca15553a-8bd5-4179-9e3d-e70d617c742d tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:32.048799 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-ca15553a-8bd5-4179-9e3d-e70d617c742d tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] [instance: 7240387f-c724-4ecb-9c26-d58666857ddf] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:32.144854 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-ca15553a-8bd5-4179-9e3d-e70d617c742d tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6b55d7cb1840a5ad93369589a36596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814c528dd56c4e61ae5cba5733bf2f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:32.159146 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-ca15553a-8bd5-4179-9e3d-e70d617c742d tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] 10.222.0.30 "GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf" status: 200 len: 1214 microversion: 2.1 time: 0.115328 Aug 09 07:03:32.173241 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 91/186] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:32 2022] GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf => generated 1214 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:32.261363 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-5e311ce3-c086-4d4d-9d19-fd3e17bb3749 req-dd0e13a3-b7c1-4653-97cb-df51f00e8170 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2236b6b2-39b4-4b81-bb86-006774babc2e", "tag": "ada64d06-0764-4487-9425-780bad419035"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:03:32.271323 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-5e311ce3-c086-4d4d-9d19-fd3e17bb3749 req-dd0e13a3-b7c1-4653-97cb-df51f00e8170 service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:32.271827 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-5e311ce3-c086-4d4d-9d19-fd3e17bb3749 req-dd0e13a3-b7c1-4653-97cb-df51f00e8170 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:32.272252 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-5e311ce3-c086-4d4d-9d19-fd3e17bb3749 req-dd0e13a3-b7c1-4653-97cb-df51f00e8170 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:32.283262 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-5e311ce3-c086-4d4d-9d19-fd3e17bb3749 req-dd0e13a3-b7c1-4653-97cb-df51f00e8170 service nova] Creating event network-changed:ada64d06-0764-4487-9425-780bad419035 for instance 2236b6b2-39b4-4b81-bb86-006774babc2e on hv-cinder-85251 Aug 09 07:03:32.288529 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-5e311ce3-c086-4d4d-9d19-fd3e17bb3749 req-dd0e13a3-b7c1-4653-97cb-df51f00e8170 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031777 Aug 09 07:03:32.289183 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 96/187] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:03:32.444454 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-bf6b7725-3665-4698-adc7-2ef4ae8fd410 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:32.445708 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-bf6b7725-3665-4698-adc7-2ef4ae8fd410 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:32.451780 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-bf6b7725-3665-4698-adc7-2ef4ae8fd410 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:32.452246 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-bf6b7725-3665-4698-adc7-2ef4ae8fd410 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:32.452675 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-bf6b7725-3665-4698-adc7-2ef4ae8fd410 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:32.453499 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-bf6b7725-3665-4698-adc7-2ef4ae8fd410 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:32.454128 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-bf6b7725-3665-4698-adc7-2ef4ae8fd410 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:32.454595 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-bf6b7725-3665-4698-adc7-2ef4ae8fd410 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:32.591049 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-bf6b7725-3665-4698-adc7-2ef4ae8fd410 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:32.600032 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-bf6b7725-3665-4698-adc7-2ef4ae8fd410 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 200 len: 1521 microversion: 2.1 time: 0.159203 Aug 09 07:03:32.600811 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 92/188] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:32 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:32.972235 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-49a803d3-1b0a-4fe3-9462-690ecdd3304b tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:32.972860 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-49a803d3-1b0a-4fe3-9462-690ecdd3304b tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:32.980466 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-49a803d3-1b0a-4fe3-9462-690ecdd3304b tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:32.980952 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-49a803d3-1b0a-4fe3-9462-690ecdd3304b tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:32.981388 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-49a803d3-1b0a-4fe3-9462-690ecdd3304b tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:32.982086 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-49a803d3-1b0a-4fe3-9462-690ecdd3304b tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:32.982547 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-49a803d3-1b0a-4fe3-9462-690ecdd3304b tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:32.982978 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-49a803d3-1b0a-4fe3-9462-690ecdd3304b tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:33.122618 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-49a803d3-1b0a-4fe3-9462-690ecdd3304b tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:33.131478 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-49a803d3-1b0a-4fe3-9462-690ecdd3304b tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1363 microversion: 2.1 time: 0.163338 Aug 09 07:03:33.132712 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 97/189] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:32 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:33.182202 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-95f8e8f1-a986-4697-b18d-7e4ad083ff67 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:33.183376 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-95f8e8f1-a986-4697-b18d-7e4ad083ff67 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] [instance: 7240387f-c724-4ecb-9c26-d58666857ddf] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:33.189805 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-95f8e8f1-a986-4697-b18d-7e4ad083ff67 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:33.190294 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-95f8e8f1-a986-4697-b18d-7e4ad083ff67 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:33.190722 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-95f8e8f1-a986-4697-b18d-7e4ad083ff67 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:33.191635 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-95f8e8f1-a986-4697-b18d-7e4ad083ff67 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:33.192112 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-95f8e8f1-a986-4697-b18d-7e4ad083ff67 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:33.192528 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-95f8e8f1-a986-4697-b18d-7e4ad083ff67 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:33.252833 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-95f8e8f1-a986-4697-b18d-7e4ad083ff67 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6b55d7cb1840a5ad93369589a36596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814c528dd56c4e61ae5cba5733bf2f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:33.262767 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-95f8e8f1-a986-4697-b18d-7e4ad083ff67 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] 10.222.0.30 "GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf" status: 200 len: 1218 microversion: 2.1 time: 0.085289 Aug 09 07:03:33.263385 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 93/190] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:33 2022] GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:33.624125 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c31157ea-eecc-4620-916e-4e156e9674d1 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:33.624656 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c31157ea-eecc-4620-916e-4e156e9674d1 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:33.630910 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c31157ea-eecc-4620-916e-4e156e9674d1 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:33.631386 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c31157ea-eecc-4620-916e-4e156e9674d1 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:33.631853 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c31157ea-eecc-4620-916e-4e156e9674d1 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:33.632699 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c31157ea-eecc-4620-916e-4e156e9674d1 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:33.633312 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c31157ea-eecc-4620-916e-4e156e9674d1 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:33.633736 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c31157ea-eecc-4620-916e-4e156e9674d1 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:33.766138 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c31157ea-eecc-4620-916e-4e156e9674d1 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:33.773589 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c31157ea-eecc-4620-916e-4e156e9674d1 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 200 len: 1521 microversion: 2.1 time: 0.153455 Aug 09 07:03:33.774182 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 98/191] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:33 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:34.152249 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-2d02d906-0556-49f6-a408-60405a3e0b88 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:34.152964 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-2d02d906-0556-49f6-a408-60405a3e0b88 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:34.158854 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2d02d906-0556-49f6-a408-60405a3e0b88 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:34.159328 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2d02d906-0556-49f6-a408-60405a3e0b88 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:34.159800 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2d02d906-0556-49f6-a408-60405a3e0b88 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:34.160475 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2d02d906-0556-49f6-a408-60405a3e0b88 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:34.160924 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2d02d906-0556-49f6-a408-60405a3e0b88 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:34.161345 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2d02d906-0556-49f6-a408-60405a3e0b88 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:34.284324 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e85e32e1-0b0c-4cdf-a599-97e159b8eb06 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:34.284961 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-e85e32e1-0b0c-4cdf-a599-97e159b8eb06 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] [instance: 7240387f-c724-4ecb-9c26-d58666857ddf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:34.292720 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e85e32e1-0b0c-4cdf-a599-97e159b8eb06 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:34.293191 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e85e32e1-0b0c-4cdf-a599-97e159b8eb06 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:34.293765 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e85e32e1-0b0c-4cdf-a599-97e159b8eb06 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:34.294296 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e85e32e1-0b0c-4cdf-a599-97e159b8eb06 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:34.294740 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e85e32e1-0b0c-4cdf-a599-97e159b8eb06 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:34.295158 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e85e32e1-0b0c-4cdf-a599-97e159b8eb06 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:34.296641 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-2d02d906-0556-49f6-a408-60405a3e0b88 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:34.304805 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-2d02d906-0556-49f6-a408-60405a3e0b88 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1363 microversion: 2.1 time: 0.155696 Aug 09 07:03:34.305724 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 94/192] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:34 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:34.357010 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e85e32e1-0b0c-4cdf-a599-97e159b8eb06 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6b55d7cb1840a5ad93369589a36596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814c528dd56c4e61ae5cba5733bf2f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:34.364396 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-e85e32e1-0b0c-4cdf-a599-97e159b8eb06 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] 10.222.0.30 "GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf" status: 200 len: 1218 microversion: 2.1 time: 0.083970 Aug 09 07:03:34.364955 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 99/193] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:34 2022] GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:03:34.795221 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-02d17172-b244-41a2-9651-e4ade5d8ee82 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:34.795872 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-02d17172-b244-41a2-9651-e4ade5d8ee82 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:34.801697 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-02d17172-b244-41a2-9651-e4ade5d8ee82 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:34.802175 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-02d17172-b244-41a2-9651-e4ade5d8ee82 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:34.802606 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-02d17172-b244-41a2-9651-e4ade5d8ee82 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:34.803283 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-02d17172-b244-41a2-9651-e4ade5d8ee82 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:34.803760 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-02d17172-b244-41a2-9651-e4ade5d8ee82 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:34.804201 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-02d17172-b244-41a2-9651-e4ade5d8ee82 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:34.933198 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-02d17172-b244-41a2-9651-e4ade5d8ee82 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:34.940695 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-02d17172-b244-41a2-9651-e4ade5d8ee82 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 200 len: 1521 microversion: 2.1 time: 0.149307 Aug 09 07:03:34.941307 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 95/194] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:34 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:35.325916 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-ccb431dd-6fb7-427e-8f50-fa238667bf2e tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:35.326529 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-ccb431dd-6fb7-427e-8f50-fa238667bf2e tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:35.332799 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ccb431dd-6fb7-427e-8f50-fa238667bf2e tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:35.333298 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ccb431dd-6fb7-427e-8f50-fa238667bf2e tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:35.333730 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ccb431dd-6fb7-427e-8f50-fa238667bf2e tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:35.334441 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ccb431dd-6fb7-427e-8f50-fa238667bf2e tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:35.334909 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ccb431dd-6fb7-427e-8f50-fa238667bf2e tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:35.335329 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ccb431dd-6fb7-427e-8f50-fa238667bf2e tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:35.386855 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-a5fc6b31-8483-4fbf-b78c-b87e997401e2 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:35.387467 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-a5fc6b31-8483-4fbf-b78c-b87e997401e2 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] [instance: 7240387f-c724-4ecb-9c26-d58666857ddf] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:35.393362 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a5fc6b31-8483-4fbf-b78c-b87e997401e2 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:35.393839 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a5fc6b31-8483-4fbf-b78c-b87e997401e2 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:35.394332 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a5fc6b31-8483-4fbf-b78c-b87e997401e2 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:35.395013 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a5fc6b31-8483-4fbf-b78c-b87e997401e2 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:35.395460 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a5fc6b31-8483-4fbf-b78c-b87e997401e2 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:35.395903 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a5fc6b31-8483-4fbf-b78c-b87e997401e2 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:35.464364 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-a5fc6b31-8483-4fbf-b78c-b87e997401e2 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6b55d7cb1840a5ad93369589a36596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814c528dd56c4e61ae5cba5733bf2f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:35.471789 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-a5fc6b31-8483-4fbf-b78c-b87e997401e2 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] 10.222.0.30 "GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf" status: 200 len: 1210 microversion: 2.1 time: 0.089264 Aug 09 07:03:35.472534 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 96/195] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:35 2022] GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf => generated 1210 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:03:35.498868 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ccb431dd-6fb7-427e-8f50-fa238667bf2e tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:35.506491 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-ccb431dd-6fb7-427e-8f50-fa238667bf2e tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1363 microversion: 2.1 time: 0.184506 Aug 09 07:03:35.507057 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 100/196] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:35 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:35.960846 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-0a53fd15-82d4-442a-88c7-bb645d307890 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:35.961499 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-0a53fd15-82d4-442a-88c7-bb645d307890 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:35.967456 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0a53fd15-82d4-442a-88c7-bb645d307890 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:35.967970 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0a53fd15-82d4-442a-88c7-bb645d307890 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:35.968408 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0a53fd15-82d4-442a-88c7-bb645d307890 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:35.969096 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0a53fd15-82d4-442a-88c7-bb645d307890 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:35.969626 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0a53fd15-82d4-442a-88c7-bb645d307890 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:35.970059 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0a53fd15-82d4-442a-88c7-bb645d307890 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:36.099424 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-0a53fd15-82d4-442a-88c7-bb645d307890 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:36.107585 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-0a53fd15-82d4-442a-88c7-bb645d307890 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 200 len: 1521 microversion: 2.1 time: 0.150569 Aug 09 07:03:36.108251 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 97/197] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:35 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:36.493961 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-df3c3256-5985-4696-9971-cc053ab397fe tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:36.494636 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-df3c3256-5985-4696-9971-cc053ab397fe tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] [instance: 7240387f-c724-4ecb-9c26-d58666857ddf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:36.500957 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-df3c3256-5985-4696-9971-cc053ab397fe tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:36.501431 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-df3c3256-5985-4696-9971-cc053ab397fe tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:36.501855 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-df3c3256-5985-4696-9971-cc053ab397fe tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:36.502532 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-df3c3256-5985-4696-9971-cc053ab397fe tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:36.502982 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-df3c3256-5985-4696-9971-cc053ab397fe tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:36.505105 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-df3c3256-5985-4696-9971-cc053ab397fe tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:36.529846 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-4c35e704-41eb-411b-a25d-9c25e9f98e1a tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:36.530560 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-4c35e704-41eb-411b-a25d-9c25e9f98e1a tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:36.536701 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4c35e704-41eb-411b-a25d-9c25e9f98e1a tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:36.547987 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4c35e704-41eb-411b-a25d-9c25e9f98e1a tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:36.548572 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4c35e704-41eb-411b-a25d-9c25e9f98e1a tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:36.549505 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4c35e704-41eb-411b-a25d-9c25e9f98e1a tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:36.550076 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4c35e704-41eb-411b-a25d-9c25e9f98e1a tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:36.550566 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4c35e704-41eb-411b-a25d-9c25e9f98e1a tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:36.575212 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-df3c3256-5985-4696-9971-cc053ab397fe tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6b55d7cb1840a5ad93369589a36596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814c528dd56c4e61ae5cba5733bf2f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:36.582901 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-df3c3256-5985-4696-9971-cc053ab397fe tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] 10.222.0.30 "GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf" status: 200 len: 1210 microversion: 2.1 time: 0.092905 Aug 09 07:03:36.583762 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 101/198] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:36 2022] GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf => generated 1210 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:36.711575 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-4c35e704-41eb-411b-a25d-9c25e9f98e1a tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:36.718993 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-4c35e704-41eb-411b-a25d-9c25e9f98e1a tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1363 microversion: 2.1 time: 0.193923 Aug 09 07:03:36.719560 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 98/199] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:36 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:37.129970 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-8166d9e1-0b99-4266-b8bd-4de247ab8e7f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:37.130563 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-8166d9e1-0b99-4266-b8bd-4de247ab8e7f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:37.137646 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8166d9e1-0b99-4266-b8bd-4de247ab8e7f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:37.138335 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8166d9e1-0b99-4266-b8bd-4de247ab8e7f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:37.138802 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8166d9e1-0b99-4266-b8bd-4de247ab8e7f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:37.139689 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8166d9e1-0b99-4266-b8bd-4de247ab8e7f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:37.140182 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8166d9e1-0b99-4266-b8bd-4de247ab8e7f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:37.140649 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8166d9e1-0b99-4266-b8bd-4de247ab8e7f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:37.145494 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:37.274999 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8166d9e1-0b99-4266-b8bd-4de247ab8e7f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:37.283194 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-8166d9e1-0b99-4266-b8bd-4de247ab8e7f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 200 len: 1521 microversion: 2.1 time: 0.157565 Aug 09 07:03:37.283807 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 102/200] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:37 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:37.604123 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-cff60a84-aa1d-4a6a-a08f-2580ccd2b2e8 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:37.604743 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-cff60a84-aa1d-4a6a-a08f-2580ccd2b2e8 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] [instance: 7240387f-c724-4ecb-9c26-d58666857ddf] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:37.610642 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cff60a84-aa1d-4a6a-a08f-2580ccd2b2e8 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:37.611126 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cff60a84-aa1d-4a6a-a08f-2580ccd2b2e8 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:37.611562 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cff60a84-aa1d-4a6a-a08f-2580ccd2b2e8 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:37.612274 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cff60a84-aa1d-4a6a-a08f-2580ccd2b2e8 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:37.612727 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cff60a84-aa1d-4a6a-a08f-2580ccd2b2e8 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:37.613150 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cff60a84-aa1d-4a6a-a08f-2580ccd2b2e8 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:37.680385 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-cff60a84-aa1d-4a6a-a08f-2580ccd2b2e8 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6b55d7cb1840a5ad93369589a36596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814c528dd56c4e61ae5cba5733bf2f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:37.688552 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-cff60a84-aa1d-4a6a-a08f-2580ccd2b2e8 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] 10.222.0.30 "GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf" status: 200 len: 1266 microversion: 2.1 time: 0.088564 Aug 09 07:03:37.689116 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 99/201] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:37 2022] GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf => generated 1266 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:03:37.739917 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b458c6f2-9fbf-47b4-8b53-fba75deb5d3a tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:37.740524 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b458c6f2-9fbf-47b4-8b53-fba75deb5d3a tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:37.747416 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b458c6f2-9fbf-47b4-8b53-fba75deb5d3a tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:37.747921 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b458c6f2-9fbf-47b4-8b53-fba75deb5d3a tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:37.748354 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b458c6f2-9fbf-47b4-8b53-fba75deb5d3a tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:37.749040 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b458c6f2-9fbf-47b4-8b53-fba75deb5d3a tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:37.749486 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b458c6f2-9fbf-47b4-8b53-fba75deb5d3a tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:37.749904 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b458c6f2-9fbf-47b4-8b53-fba75deb5d3a tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:37.892836 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b458c6f2-9fbf-47b4-8b53-fba75deb5d3a tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:37.900797 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b458c6f2-9fbf-47b4-8b53-fba75deb5d3a tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1549 microversion: 2.1 time: 0.164562 Aug 09 07:03:37.901768 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 103/202] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:37 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1549 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:37.936581 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-3d2df43d-4385-40dc-96c0-6f2e2cca971b tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:37.937400 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-3d2df43d-4385-40dc-96c0-6f2e2cca971b tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:37.957632 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3d2df43d-4385-40dc-96c0-6f2e2cca971b tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:37.958755 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3d2df43d-4385-40dc-96c0-6f2e2cca971b tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:37.959259 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3d2df43d-4385-40dc-96c0-6f2e2cca971b tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:37.963004 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3d2df43d-4385-40dc-96c0-6f2e2cca971b tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:37.963495 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3d2df43d-4385-40dc-96c0-6f2e2cca971b tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:37.963999 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3d2df43d-4385-40dc-96c0-6f2e2cca971b tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:38.052329 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-3d2df43d-4385-40dc-96c0-6f2e2cca971b tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.132341 Aug 09 07:03:38.052924 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 100/203] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Aug 9 07:03:37 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46/os-interface => generated 284 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:03:38.315491 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-1c66e4b9-0896-424a-8651-32297392f134 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:38.316622 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-1c66e4b9-0896-424a-8651-32297392f134 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:38.347967 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1c66e4b9-0896-424a-8651-32297392f134 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:38.348813 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1c66e4b9-0896-424a-8651-32297392f134 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:38.349754 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1c66e4b9-0896-424a-8651-32297392f134 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:38.350617 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1c66e4b9-0896-424a-8651-32297392f134 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:38.351464 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1c66e4b9-0896-424a-8651-32297392f134 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:38.352116 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1c66e4b9-0896-424a-8651-32297392f134 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:38.639403 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-1c66e4b9-0896-424a-8651-32297392f134 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:38.651291 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-1c66e4b9-0896-424a-8651-32297392f134 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 200 len: 1521 microversion: 2.1 time: 0.350605 Aug 09 07:03:38.669127 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 104/204] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:38 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 1521 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:38.712905 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-8ee630c0-836b-46c3-8f8e-ffbea5d40b58 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:38.713515 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-8ee630c0-836b-46c3-8f8e-ffbea5d40b58 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] [instance: 7240387f-c724-4ecb-9c26-d58666857ddf] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:38.723454 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-8ee630c0-836b-46c3-8f8e-ffbea5d40b58 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:38.724291 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-8ee630c0-836b-46c3-8f8e-ffbea5d40b58 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:38.724952 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-8ee630c0-836b-46c3-8f8e-ffbea5d40b58 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:38.726137 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-8ee630c0-836b-46c3-8f8e-ffbea5d40b58 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:38.726732 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-8ee630c0-836b-46c3-8f8e-ffbea5d40b58 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:38.728884 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-8ee630c0-836b-46c3-8f8e-ffbea5d40b58 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:38.878462 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-8ee630c0-836b-46c3-8f8e-ffbea5d40b58 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6b55d7cb1840a5ad93369589a36596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814c528dd56c4e61ae5cba5733bf2f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:38.895439 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-8ee630c0-836b-46c3-8f8e-ffbea5d40b58 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] 10.222.0.30 "GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf" status: 200 len: 1274 microversion: 2.1 time: 0.187064 Aug 09 07:03:38.896305 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 101/205] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:38 2022] GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf => generated 1274 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:39.461758 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-c94ffbb6-8742-419a-bb2d-6c5f7bee0fac req-9a54d79b-a062-497a-854b-710f1bb22156 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46", "tag": "8ca46829-e122-42ef-87e0-c5d0bd4f1294"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:03:39.476582 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-c94ffbb6-8742-419a-bb2d-6c5f7bee0fac req-9a54d79b-a062-497a-854b-710f1bb22156 service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:39.477189 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-c94ffbb6-8742-419a-bb2d-6c5f7bee0fac req-9a54d79b-a062-497a-854b-710f1bb22156 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:39.478356 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-c94ffbb6-8742-419a-bb2d-6c5f7bee0fac req-9a54d79b-a062-497a-854b-710f1bb22156 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:39.500930 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-c94ffbb6-8742-419a-bb2d-6c5f7bee0fac req-9a54d79b-a062-497a-854b-710f1bb22156 service nova] Creating event network-changed:8ca46829-e122-42ef-87e0-c5d0bd4f1294 for instance 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 on hv-cinder-85251 Aug 09 07:03:39.512346 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-c94ffbb6-8742-419a-bb2d-6c5f7bee0fac req-9a54d79b-a062-497a-854b-710f1bb22156 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053878 Aug 09 07:03:39.514885 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 105/206] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:03:39.679778 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-a3a5d9c1-6ce5-4289-baa9-fddb7bd9cd07 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:39.680844 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-56ba6ebb-a884-4c52-920d-c4cd5fdc5835 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:39.681554 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-56ba6ebb-a884-4c52-920d-c4cd5fdc5835 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:39.683716 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-a3a5d9c1-6ce5-4289-baa9-fddb7bd9cd07 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] [instance: 9883f029-68a3-4946-b14b-47721b72f3db] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:39.692770 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a3a5d9c1-6ce5-4289-baa9-fddb7bd9cd07 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:39.695713 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-56ba6ebb-a884-4c52-920d-c4cd5fdc5835 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:39.696812 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-56ba6ebb-a884-4c52-920d-c4cd5fdc5835 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:39.697195 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a3a5d9c1-6ce5-4289-baa9-fddb7bd9cd07 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:39.697862 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a3a5d9c1-6ce5-4289-baa9-fddb7bd9cd07 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:39.698772 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a3a5d9c1-6ce5-4289-baa9-fddb7bd9cd07 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:39.699468 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a3a5d9c1-6ce5-4289-baa9-fddb7bd9cd07 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:39.700191 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-56ba6ebb-a884-4c52-920d-c4cd5fdc5835 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:39.700843 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a3a5d9c1-6ce5-4289-baa9-fddb7bd9cd07 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:39.701778 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-56ba6ebb-a884-4c52-920d-c4cd5fdc5835 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:39.706821 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-56ba6ebb-a884-4c52-920d-c4cd5fdc5835 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:39.707571 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-56ba6ebb-a884-4c52-920d-c4cd5fdc5835 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:39.751157 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-a3a5d9c1-6ce5-4289-baa9-fddb7bd9cd07 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] [instance: 9883f029-68a3-4946-b14b-47721b72f3db] Going to try to terminate instance {{(pid=117858) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 07:03:39.847887 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:39.909495 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-a3a5d9c1-6ce5-4289-baa9-fddb7bd9cd07 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db" status: 204 len: 0 microversion: 2.1 time: 0.239444 Aug 09 07:03:39.910647 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 102/207] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 9 07:03:39 2022] DELETE /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 07:03:39.920384 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-251664be-215f-449b-814a-ea356ca88edc tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:39.921403 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-251664be-215f-449b-814a-ea356ca88edc tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] [instance: 7240387f-c724-4ecb-9c26-d58666857ddf] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:39.932104 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-251664be-215f-449b-814a-ea356ca88edc tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:39.933303 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-251664be-215f-449b-814a-ea356ca88edc tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:39.933915 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-251664be-215f-449b-814a-ea356ca88edc tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:39.934960 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-251664be-215f-449b-814a-ea356ca88edc tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:39.935426 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-251664be-215f-449b-814a-ea356ca88edc tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:39.936258 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-251664be-215f-449b-814a-ea356ca88edc tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:40.333989 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-56ba6ebb-a884-4c52-920d-c4cd5fdc5835 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:40.342776 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-56ba6ebb-a884-4c52-920d-c4cd5fdc5835 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 200 len: 1521 microversion: 2.1 time: 0.668329 Aug 09 07:03:40.343636 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 106/208] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:39 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 1521 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:40.348305 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e858b50d-beb1-4b6e-8f53-fca116a25081 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:40.349170 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-e858b50d-beb1-4b6e-8f53-fca116a25081 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] [instance: 9883f029-68a3-4946-b14b-47721b72f3db] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:40.355820 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e858b50d-beb1-4b6e-8f53-fca116a25081 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:40.356588 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e858b50d-beb1-4b6e-8f53-fca116a25081 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:40.357212 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e858b50d-beb1-4b6e-8f53-fca116a25081 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:40.358103 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e858b50d-beb1-4b6e-8f53-fca116a25081 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:40.358792 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e858b50d-beb1-4b6e-8f53-fca116a25081 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:40.359389 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e858b50d-beb1-4b6e-8f53-fca116a25081 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:40.421261 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-251664be-215f-449b-814a-ea356ca88edc tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6b55d7cb1840a5ad93369589a36596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814c528dd56c4e61ae5cba5733bf2f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:40.429520 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-251664be-215f-449b-814a-ea356ca88edc tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] 10.222.0.30 "GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf" status: 200 len: 1314 microversion: 2.1 time: 0.513896 Aug 09 07:03:40.430764 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 103/209] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:39 2022] GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf => generated 1314 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:40.555013 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e858b50d-beb1-4b6e-8f53-fca116a25081 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef078fe46d418c95f35e1f0bdd2f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8f338b40e4d7e9a6249084bcdaa73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:40.564911 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-e858b50d-beb1-4b6e-8f53-fca116a25081 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] 10.222.0.30 "GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db" status: 200 len: 1553 microversion: 2.1 time: 0.220010 Aug 09 07:03:40.565855 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 107/210] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:40 2022] GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db => generated 1553 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:41.363426 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-cef70cbe-20d7-4fb6-9307-d99a8a9eaa78 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:41.364077 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-cef70cbe-20d7-4fb6-9307-d99a8a9eaa78 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:41.371265 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cef70cbe-20d7-4fb6-9307-d99a8a9eaa78 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:41.371792 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cef70cbe-20d7-4fb6-9307-d99a8a9eaa78 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:41.372223 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cef70cbe-20d7-4fb6-9307-d99a8a9eaa78 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:41.372896 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cef70cbe-20d7-4fb6-9307-d99a8a9eaa78 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:41.373341 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cef70cbe-20d7-4fb6-9307-d99a8a9eaa78 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:41.373877 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cef70cbe-20d7-4fb6-9307-d99a8a9eaa78 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:41.452086 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e3a15a8d-e59e-46d7-8f23-6191bdf4aca2 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:41.452962 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-e3a15a8d-e59e-46d7-8f23-6191bdf4aca2 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] [instance: 7240387f-c724-4ecb-9c26-d58666857ddf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:41.459085 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e3a15a8d-e59e-46d7-8f23-6191bdf4aca2 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:41.459910 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e3a15a8d-e59e-46d7-8f23-6191bdf4aca2 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:41.460513 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e3a15a8d-e59e-46d7-8f23-6191bdf4aca2 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:41.461213 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e3a15a8d-e59e-46d7-8f23-6191bdf4aca2 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:41.461699 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e3a15a8d-e59e-46d7-8f23-6191bdf4aca2 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:41.462127 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e3a15a8d-e59e-46d7-8f23-6191bdf4aca2 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:41.523815 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-cef70cbe-20d7-4fb6-9307-d99a8a9eaa78 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:41.532698 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-cef70cbe-20d7-4fb6-9307-d99a8a9eaa78 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 200 len: 1521 microversion: 2.1 time: 0.173048 Aug 09 07:03:41.533664 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 104/211] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:41 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:41.593336 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-61a447c0-7f4c-43fd-baf8-d9b7990120b7 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:41.594323 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-61a447c0-7f4c-43fd-baf8-d9b7990120b7 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] [instance: 9883f029-68a3-4946-b14b-47721b72f3db] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:41.602157 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-61a447c0-7f4c-43fd-baf8-d9b7990120b7 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:41.603148 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-61a447c0-7f4c-43fd-baf8-d9b7990120b7 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:41.606942 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-61a447c0-7f4c-43fd-baf8-d9b7990120b7 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:41.608143 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-61a447c0-7f4c-43fd-baf8-d9b7990120b7 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:41.608275 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-61a447c0-7f4c-43fd-baf8-d9b7990120b7 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:41.609010 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-61a447c0-7f4c-43fd-baf8-d9b7990120b7 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:41.639765 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e3a15a8d-e59e-46d7-8f23-6191bdf4aca2 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6b55d7cb1840a5ad93369589a36596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814c528dd56c4e61ae5cba5733bf2f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:41.651975 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-e3a15a8d-e59e-46d7-8f23-6191bdf4aca2 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] 10.222.0.30 "GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf" status: 200 len: 1314 microversion: 2.1 time: 0.202717 Aug 09 07:03:41.652792 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 108/212] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:41 2022] GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:03:41.789590 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-61a447c0-7f4c-43fd-baf8-d9b7990120b7 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef078fe46d418c95f35e1f0bdd2f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8f338b40e4d7e9a6249084bcdaa73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:41.804417 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-61a447c0-7f4c-43fd-baf8-d9b7990120b7 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] 10.222.0.30 "GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db" status: 200 len: 1553 microversion: 2.1 time: 0.215048 Aug 09 07:03:41.804417 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 105/213] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:41 2022] GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db => generated 1553 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:42.556714 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-5656282f-fd29-4599-80b1-14e50229cbe1 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:42.557492 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-5656282f-fd29-4599-80b1-14e50229cbe1 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:42.567007 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=2 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:42.568112 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=6 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:42.572354 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5656282f-fd29-4599-80b1-14e50229cbe1 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:42.573056 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5656282f-fd29-4599-80b1-14e50229cbe1 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:42.573329 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5656282f-fd29-4599-80b1-14e50229cbe1 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:42.574038 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5656282f-fd29-4599-80b1-14e50229cbe1 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:42.574495 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5656282f-fd29-4599-80b1-14e50229cbe1 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:42.574919 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5656282f-fd29-4599-80b1-14e50229cbe1 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:42.675897 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-2c59050d-bee4-400a-a75d-2ea0247ef1b7 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:42.676906 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-2c59050d-bee4-400a-a75d-2ea0247ef1b7 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] [instance: 7240387f-c724-4ecb-9c26-d58666857ddf] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:42.679133 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_cell0:SELECT=2 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:42.693892 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2c59050d-bee4-400a-a75d-2ea0247ef1b7 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:42.694548 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2c59050d-bee4-400a-a75d-2ea0247ef1b7 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:42.695081 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2c59050d-bee4-400a-a75d-2ea0247ef1b7 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:42.696479 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2c59050d-bee4-400a-a75d-2ea0247ef1b7 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:42.697202 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2c59050d-bee4-400a-a75d-2ea0247ef1b7 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:42.697809 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2c59050d-bee4-400a-a75d-2ea0247ef1b7 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:42.919114 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-5656282f-fd29-4599-80b1-14e50229cbe1 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:42.927782 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-5656282f-fd29-4599-80b1-14e50229cbe1 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 200 len: 1521 microversion: 2.1 time: 0.375504 Aug 09 07:03:42.928432 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 109/214] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:42 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 1521 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:42.949857 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-ed622206-65b9-4fe2-a96c-e983d037f054 req-9b1f42bc-011f-4901-ad4b-dcee68b2d2ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7240387f-c724-4ecb-9c26-d58666857ddf", "tag": "be1a1b6c-36b3-4e80-8755-5e36c38bee83"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:03:42.960123 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-ed622206-65b9-4fe2-a96c-e983d037f054 req-9b1f42bc-011f-4901-ad4b-dcee68b2d2ba service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:42.960962 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-ed622206-65b9-4fe2-a96c-e983d037f054 req-9b1f42bc-011f-4901-ad4b-dcee68b2d2ba service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:42.961850 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-ed622206-65b9-4fe2-a96c-e983d037f054 req-9b1f42bc-011f-4901-ad4b-dcee68b2d2ba service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:42.970516 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-2c59050d-bee4-400a-a75d-2ea0247ef1b7 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6b55d7cb1840a5ad93369589a36596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814c528dd56c4e61ae5cba5733bf2f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:42.977314 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-ed622206-65b9-4fe2-a96c-e983d037f054 req-9b1f42bc-011f-4901-ad4b-dcee68b2d2ba service nova] Creating event network-changed:be1a1b6c-36b3-4e80-8755-5e36c38bee83 for instance 7240387f-c724-4ecb-9c26-d58666857ddf on hv-cinder-85251 Aug 09 07:03:42.982267 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-2c59050d-bee4-400a-a75d-2ea0247ef1b7 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] 10.222.0.30 "GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf" status: 200 len: 1314 microversion: 2.1 time: 0.310586 Aug 09 07:03:42.983700 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-ed622206-65b9-4fe2-a96c-e983d037f054 req-9b1f42bc-011f-4901-ad4b-dcee68b2d2ba service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041077 Aug 09 07:03:42.983838 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 106/215] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:42 2022] GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:03:42.984688 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 110/216] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:03:42.990277 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-80d3a8ff-b2f5-46b1-b067-4eb33b640f1c tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:42.991020 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-80d3a8ff-b2f5-46b1-b067-4eb33b640f1c tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] [instance: 9883f029-68a3-4946-b14b-47721b72f3db] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:42.999975 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-80d3a8ff-b2f5-46b1-b067-4eb33b640f1c tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:43.000576 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-80d3a8ff-b2f5-46b1-b067-4eb33b640f1c tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:43.001122 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-80d3a8ff-b2f5-46b1-b067-4eb33b640f1c tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:43.002012 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-80d3a8ff-b2f5-46b1-b067-4eb33b640f1c tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:43.002961 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-80d3a8ff-b2f5-46b1-b067-4eb33b640f1c tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:43.003242 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-80d3a8ff-b2f5-46b1-b067-4eb33b640f1c tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:43.161340 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-80d3a8ff-b2f5-46b1-b067-4eb33b640f1c tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef078fe46d418c95f35e1f0bdd2f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8f338b40e4d7e9a6249084bcdaa73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:43.171919 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-80d3a8ff-b2f5-46b1-b067-4eb33b640f1c tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] 10.222.0.30 "GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db" status: 200 len: 1511 microversion: 2.1 time: 0.186694 Aug 09 07:03:43.183109 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 107/217] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:42 2022] GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db => generated 1511 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:43.197607 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-e0b45cd3-44c5-452c-b535-c97771e9d168 req-06779c19-01e0-4b29-93b6-5faf1bcc028e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9883f029-68a3-4946-b14b-47721b72f3db", "name": "network-vif-deleted", "tag": "823c14f0-b1a9-4950-bf0e-c762cdeb2d8f"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:03:43.208079 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-e0b45cd3-44c5-452c-b535-c97771e9d168 req-06779c19-01e0-4b29-93b6-5faf1bcc028e service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:43.208674 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-e0b45cd3-44c5-452c-b535-c97771e9d168 req-06779c19-01e0-4b29-93b6-5faf1bcc028e service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:43.209115 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-e0b45cd3-44c5-452c-b535-c97771e9d168 req-06779c19-01e0-4b29-93b6-5faf1bcc028e service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:43.222643 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-e0b45cd3-44c5-452c-b535-c97771e9d168 req-06779c19-01e0-4b29-93b6-5faf1bcc028e service nova] Creating event network-vif-deleted:823c14f0-b1a9-4950-bf0e-c762cdeb2d8f for instance 9883f029-68a3-4946-b14b-47721b72f3db on hv-cinder-85251 Aug 09 07:03:43.228695 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-e0b45cd3-44c5-452c-b535-c97771e9d168 req-06779c19-01e0-4b29-93b6-5faf1bcc028e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037530 Aug 09 07:03:43.229229 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 111/218] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:03:43.952404 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-7c6293cf-a7cd-4dc3-874e-94cfaa14b6dd tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:43.953004 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-7c6293cf-a7cd-4dc3-874e-94cfaa14b6dd tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:43.958942 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7c6293cf-a7cd-4dc3-874e-94cfaa14b6dd tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:43.959348 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7c6293cf-a7cd-4dc3-874e-94cfaa14b6dd tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:43.959816 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7c6293cf-a7cd-4dc3-874e-94cfaa14b6dd tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:43.960489 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7c6293cf-a7cd-4dc3-874e-94cfaa14b6dd tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:43.960931 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7c6293cf-a7cd-4dc3-874e-94cfaa14b6dd tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:43.961344 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7c6293cf-a7cd-4dc3-874e-94cfaa14b6dd tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:44.006639 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c571c1e7-1677-442d-a1a3-bbe53de71cac tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:44.007514 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c571c1e7-1677-442d-a1a3-bbe53de71cac tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] [instance: 7240387f-c724-4ecb-9c26-d58666857ddf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:44.015087 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c571c1e7-1677-442d-a1a3-bbe53de71cac tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:44.015741 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c571c1e7-1677-442d-a1a3-bbe53de71cac tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:44.016257 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c571c1e7-1677-442d-a1a3-bbe53de71cac tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:44.017005 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c571c1e7-1677-442d-a1a3-bbe53de71cac tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:44.017525 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c571c1e7-1677-442d-a1a3-bbe53de71cac tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:44.018016 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c571c1e7-1677-442d-a1a3-bbe53de71cac tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:44.143897 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-7c6293cf-a7cd-4dc3-874e-94cfaa14b6dd tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:44.151989 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-7c6293cf-a7cd-4dc3-874e-94cfaa14b6dd tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 200 len: 1521 microversion: 2.1 time: 0.203264 Aug 09 07:03:44.152568 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 108/219] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:43 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:44.179926 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c571c1e7-1677-442d-a1a3-bbe53de71cac tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6b55d7cb1840a5ad93369589a36596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814c528dd56c4e61ae5cba5733bf2f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:44.187382 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c571c1e7-1677-442d-a1a3-bbe53de71cac tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] 10.222.0.30 "GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf" status: 200 len: 1314 microversion: 2.1 time: 0.185330 Aug 09 07:03:44.187985 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 112/220] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:44 2022] GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:03:44.195710 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-193ba93d-0330-42a1-bbd0-967d394784c8 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:44.197270 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-193ba93d-0330-42a1-bbd0-967d394784c8 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] [instance: 9883f029-68a3-4946-b14b-47721b72f3db] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:44.203052 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-193ba93d-0330-42a1-bbd0-967d394784c8 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:44.203524 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-193ba93d-0330-42a1-bbd0-967d394784c8 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:44.203983 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-193ba93d-0330-42a1-bbd0-967d394784c8 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:44.204657 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-193ba93d-0330-42a1-bbd0-967d394784c8 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:44.205101 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-193ba93d-0330-42a1-bbd0-967d394784c8 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:44.205515 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-193ba93d-0330-42a1-bbd0-967d394784c8 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:44.236168 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-193ba93d-0330-42a1-bbd0-967d394784c8 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:44.236563 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-193ba93d-0330-42a1-bbd0-967d394784c8 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:44.236994 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-193ba93d-0330-42a1-bbd0-967d394784c8 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:44.237553 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.objects.instance [None req-193ba93d-0330-42a1-bbd0-967d394784c8 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lazy-loading 'fault' on Instance uuid 9883f029-68a3-4946-b14b-47721b72f3db {{(pid=117858) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 07:03:44.280461 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-193ba93d-0330-42a1-bbd0-967d394784c8 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef078fe46d418c95f35e1f0bdd2f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8f338b40e4d7e9a6249084bcdaa73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:44.288321 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-193ba93d-0330-42a1-bbd0-967d394784c8 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] 10.222.0.30 "GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db" status: 200 len: 1516 microversion: 2.1 time: 0.096376 Aug 09 07:03:44.288874 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 109/221] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:44 2022] GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db => generated 1516 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:45.172851 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-02c58b5e-8e56-4c68-924d-ce544bbab8e3 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:45.173461 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-02c58b5e-8e56-4c68-924d-ce544bbab8e3 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:45.179865 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-02c58b5e-8e56-4c68-924d-ce544bbab8e3 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:45.181011 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-02c58b5e-8e56-4c68-924d-ce544bbab8e3 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:45.181465 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-02c58b5e-8e56-4c68-924d-ce544bbab8e3 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:45.182108 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-02c58b5e-8e56-4c68-924d-ce544bbab8e3 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:45.182558 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-02c58b5e-8e56-4c68-924d-ce544bbab8e3 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:45.182990 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-02c58b5e-8e56-4c68-924d-ce544bbab8e3 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:45.208316 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-1619930e-0295-46f7-b8e3-edd6ddfbcb06 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:45.208919 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-1619930e-0295-46f7-b8e3-edd6ddfbcb06 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] [instance: 7240387f-c724-4ecb-9c26-d58666857ddf] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:45.215087 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1619930e-0295-46f7-b8e3-edd6ddfbcb06 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:45.215557 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1619930e-0295-46f7-b8e3-edd6ddfbcb06 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:45.216011 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1619930e-0295-46f7-b8e3-edd6ddfbcb06 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:45.216689 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1619930e-0295-46f7-b8e3-edd6ddfbcb06 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:45.217132 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1619930e-0295-46f7-b8e3-edd6ddfbcb06 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:45.217548 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1619930e-0295-46f7-b8e3-edd6ddfbcb06 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:45.366228 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-02c58b5e-8e56-4c68-924d-ce544bbab8e3 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:45.374389 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-02c58b5e-8e56-4c68-924d-ce544bbab8e3 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 200 len: 1521 microversion: 2.1 time: 0.205381 Aug 09 07:03:45.374964 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 113/222] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:45 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:45.379568 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-15912699-ca6e-4e78-bd16-b5997c180ac8 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:45.380195 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-15912699-ca6e-4e78-bd16-b5997c180ac8 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] [instance: 9883f029-68a3-4946-b14b-47721b72f3db] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:45.386738 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-15912699-ca6e-4e78-bd16-b5997c180ac8 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:45.387273 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-15912699-ca6e-4e78-bd16-b5997c180ac8 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:45.387669 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-15912699-ca6e-4e78-bd16-b5997c180ac8 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:45.388357 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-15912699-ca6e-4e78-bd16-b5997c180ac8 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:45.388812 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-15912699-ca6e-4e78-bd16-b5997c180ac8 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:45.389226 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-15912699-ca6e-4e78-bd16-b5997c180ac8 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:45.390468 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-1619930e-0295-46f7-b8e3-edd6ddfbcb06 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6b55d7cb1840a5ad93369589a36596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814c528dd56c4e61ae5cba5733bf2f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:45.397889 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-1619930e-0295-46f7-b8e3-edd6ddfbcb06 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] 10.222.0.30 "GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf" status: 200 len: 1314 microversion: 2.1 time: 0.193767 Aug 09 07:03:45.398448 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 110/223] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:45 2022] GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:03:45.419618 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-15912699-ca6e-4e78-bd16-b5997c180ac8 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:45.420114 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-15912699-ca6e-4e78-bd16-b5997c180ac8 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:45.420561 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-15912699-ca6e-4e78-bd16-b5997c180ac8 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:45.420992 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.objects.instance [None req-15912699-ca6e-4e78-bd16-b5997c180ac8 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lazy-loading 'fault' on Instance uuid 9883f029-68a3-4946-b14b-47721b72f3db {{(pid=117859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 07:03:45.464726 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-15912699-ca6e-4e78-bd16-b5997c180ac8 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef078fe46d418c95f35e1f0bdd2f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8f338b40e4d7e9a6249084bcdaa73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:45.472391 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-15912699-ca6e-4e78-bd16-b5997c180ac8 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] 10.222.0.30 "GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db" status: 200 len: 1516 microversion: 2.1 time: 0.096508 Aug 09 07:03:45.472951 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 114/224] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:45 2022] GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db => generated 1516 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:46.395843 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-5adaf56f-b8ea-4298-abd1-d1151e933a3f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:46.396469 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-5adaf56f-b8ea-4298-abd1-d1151e933a3f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:46.402989 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5adaf56f-b8ea-4298-abd1-d1151e933a3f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:46.403470 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5adaf56f-b8ea-4298-abd1-d1151e933a3f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:46.403951 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5adaf56f-b8ea-4298-abd1-d1151e933a3f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:46.404627 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5adaf56f-b8ea-4298-abd1-d1151e933a3f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:46.405082 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5adaf56f-b8ea-4298-abd1-d1151e933a3f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:46.405510 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5adaf56f-b8ea-4298-abd1-d1151e933a3f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:46.418198 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f2cc8da5-25c7-4acd-9ffe-6149e18211c3 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:46.418900 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-f2cc8da5-25c7-4acd-9ffe-6149e18211c3 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] [instance: 7240387f-c724-4ecb-9c26-d58666857ddf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:46.425332 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f2cc8da5-25c7-4acd-9ffe-6149e18211c3 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:46.425822 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f2cc8da5-25c7-4acd-9ffe-6149e18211c3 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:46.426253 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f2cc8da5-25c7-4acd-9ffe-6149e18211c3 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:46.426936 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f2cc8da5-25c7-4acd-9ffe-6149e18211c3 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:46.427385 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f2cc8da5-25c7-4acd-9ffe-6149e18211c3 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:46.427834 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f2cc8da5-25c7-4acd-9ffe-6149e18211c3 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:46.601518 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-5adaf56f-b8ea-4298-abd1-d1151e933a3f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:46.603573 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-f2cc8da5-25c7-4acd-9ffe-6149e18211c3 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6b55d7cb1840a5ad93369589a36596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814c528dd56c4e61ae5cba5733bf2f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:46.609302 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-5adaf56f-b8ea-4298-abd1-d1151e933a3f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 200 len: 1521 microversion: 2.1 time: 0.217386 Aug 09 07:03:46.609877 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 111/225] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:46 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:46.611108 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f2cc8da5-25c7-4acd-9ffe-6149e18211c3 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] 10.222.0.30 "GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf" status: 200 len: 1314 microversion: 2.1 time: 0.196732 Aug 09 07:03:46.611878 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 115/226] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:46 2022] GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:03:46.614245 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-791ba28c-fa2f-4fe9-b0f0-4133855bd115 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:46.614830 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-791ba28c-fa2f-4fe9-b0f0-4133855bd115 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] [instance: 9883f029-68a3-4946-b14b-47721b72f3db] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:46.620896 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-791ba28c-fa2f-4fe9-b0f0-4133855bd115 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:46.621446 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-791ba28c-fa2f-4fe9-b0f0-4133855bd115 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:46.621948 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-791ba28c-fa2f-4fe9-b0f0-4133855bd115 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:46.622696 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-791ba28c-fa2f-4fe9-b0f0-4133855bd115 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:46.623210 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-791ba28c-fa2f-4fe9-b0f0-4133855bd115 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:46.623726 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-791ba28c-fa2f-4fe9-b0f0-4133855bd115 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:46.654998 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-791ba28c-fa2f-4fe9-b0f0-4133855bd115 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:46.655527 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-791ba28c-fa2f-4fe9-b0f0-4133855bd115 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:46.655947 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-791ba28c-fa2f-4fe9-b0f0-4133855bd115 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:46.656490 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.objects.instance [None req-791ba28c-fa2f-4fe9-b0f0-4133855bd115 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lazy-loading 'fault' on Instance uuid 9883f029-68a3-4946-b14b-47721b72f3db {{(pid=117858) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 07:03:46.699422 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-791ba28c-fa2f-4fe9-b0f0-4133855bd115 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef078fe46d418c95f35e1f0bdd2f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8f338b40e4d7e9a6249084bcdaa73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:46.707258 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-791ba28c-fa2f-4fe9-b0f0-4133855bd115 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] 10.222.0.30 "GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db" status: 200 len: 1516 microversion: 2.1 time: 0.096457 Aug 09 07:03:46.707871 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 112/227] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:46 2022] GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db => generated 1516 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:47.631402 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-837474f6-c527-403e-8348-de36e166d320 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:47.632108 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f4691050-23b6-46b5-834b-e697282d4865 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:47.632541 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-837474f6-c527-403e-8348-de36e166d320 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] [instance: 7240387f-c724-4ecb-9c26-d58666857ddf] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:47.632635 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-f4691050-23b6-46b5-834b-e697282d4865 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:47.638259 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-837474f6-c527-403e-8348-de36e166d320 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:47.638760 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-837474f6-c527-403e-8348-de36e166d320 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:47.639183 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-837474f6-c527-403e-8348-de36e166d320 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:47.639899 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-837474f6-c527-403e-8348-de36e166d320 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:47.640004 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f4691050-23b6-46b5-834b-e697282d4865 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:47.640349 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-837474f6-c527-403e-8348-de36e166d320 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:47.640454 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f4691050-23b6-46b5-834b-e697282d4865 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:47.640771 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-837474f6-c527-403e-8348-de36e166d320 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:47.640864 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f4691050-23b6-46b5-834b-e697282d4865 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:47.641524 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f4691050-23b6-46b5-834b-e697282d4865 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:47.641979 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f4691050-23b6-46b5-834b-e697282d4865 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:47.642401 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f4691050-23b6-46b5-834b-e697282d4865 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:47.837601 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-837474f6-c527-403e-8348-de36e166d320 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6b55d7cb1840a5ad93369589a36596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814c528dd56c4e61ae5cba5733bf2f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:47.840823 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-f4691050-23b6-46b5-834b-e697282d4865 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:47.845364 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-837474f6-c527-403e-8348-de36e166d320 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] 10.222.0.30 "GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf" status: 200 len: 1314 microversion: 2.1 time: 0.217951 Aug 09 07:03:47.846125 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 113/228] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:47 2022] GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:47.848376 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f4691050-23b6-46b5-834b-e697282d4865 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 200 len: 1521 microversion: 2.1 time: 0.220983 Aug 09 07:03:47.848937 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 116/229] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:47 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:47.850783 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-cfa5f7c7-33de-45c9-bb9a-bdff995818db tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:47.851523 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-cfa5f7c7-33de-45c9-bb9a-bdff995818db tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] [instance: 9883f029-68a3-4946-b14b-47721b72f3db] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:47.857689 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cfa5f7c7-33de-45c9-bb9a-bdff995818db tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:47.858228 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cfa5f7c7-33de-45c9-bb9a-bdff995818db tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:47.858715 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cfa5f7c7-33de-45c9-bb9a-bdff995818db tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:47.859535 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cfa5f7c7-33de-45c9-bb9a-bdff995818db tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:47.860078 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cfa5f7c7-33de-45c9-bb9a-bdff995818db tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:47.860508 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cfa5f7c7-33de-45c9-bb9a-bdff995818db tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:47.891462 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cfa5f7c7-33de-45c9-bb9a-bdff995818db tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:47.891972 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cfa5f7c7-33de-45c9-bb9a-bdff995818db tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:47.892408 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cfa5f7c7-33de-45c9-bb9a-bdff995818db tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:47.892849 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.objects.instance [None req-cfa5f7c7-33de-45c9-bb9a-bdff995818db tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lazy-loading 'fault' on Instance uuid 9883f029-68a3-4946-b14b-47721b72f3db {{(pid=117858) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 07:03:47.932720 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-cfa5f7c7-33de-45c9-bb9a-bdff995818db tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20ef078fe46d418c95f35e1f0bdd2f2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1b8f338b40e4d7e9a6249084bcdaa73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:47.940772 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-cfa5f7c7-33de-45c9-bb9a-bdff995818db tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] 10.222.0.30 "GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db" status: 200 len: 1516 microversion: 2.1 time: 0.093531 Aug 09 07:03:47.941328 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 114/230] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:47 2022] GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db => generated 1516 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:48.866428 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4c021739-0abf-43d6-be93-c7629f04b97d tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:48.867039 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4c021739-0abf-43d6-be93-c7629f04b97d tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] [instance: 7240387f-c724-4ecb-9c26-d58666857ddf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:48.869384 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-e575e4cb-9296-499c-a0bd-d5910d7e3acb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:48.869999 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-e575e4cb-9296-499c-a0bd-d5910d7e3acb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:48.874137 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4c021739-0abf-43d6-be93-c7629f04b97d tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:48.874619 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4c021739-0abf-43d6-be93-c7629f04b97d tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:48.875048 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4c021739-0abf-43d6-be93-c7629f04b97d tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:48.875839 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4c021739-0abf-43d6-be93-c7629f04b97d tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:48.875949 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e575e4cb-9296-499c-a0bd-d5910d7e3acb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:48.876291 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4c021739-0abf-43d6-be93-c7629f04b97d tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:48.876397 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e575e4cb-9296-499c-a0bd-d5910d7e3acb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:48.876710 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4c021739-0abf-43d6-be93-c7629f04b97d tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:48.876825 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e575e4cb-9296-499c-a0bd-d5910d7e3acb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:48.877482 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e575e4cb-9296-499c-a0bd-d5910d7e3acb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:48.877933 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e575e4cb-9296-499c-a0bd-d5910d7e3acb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:48.878355 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e575e4cb-9296-499c-a0bd-d5910d7e3acb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:49.071353 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4c021739-0abf-43d6-be93-c7629f04b97d tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6b55d7cb1840a5ad93369589a36596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814c528dd56c4e61ae5cba5733bf2f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:49.074394 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-e575e4cb-9296-499c-a0bd-d5910d7e3acb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:49.078824 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4c021739-0abf-43d6-be93-c7629f04b97d tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] 10.222.0.30 "GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf" status: 200 len: 1314 microversion: 2.1 time: 0.216761 Aug 09 07:03:49.079482 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 117/231] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:48 2022] GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:49.082043 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-e575e4cb-9296-499c-a0bd-d5910d7e3acb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 200 len: 1521 microversion: 2.1 time: 0.217139 Aug 09 07:03:49.082781 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 115/232] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:48 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:03:49.086252 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-5332a4fa-6448-49db-8a3d-d9536baeba40 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:49.087012 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-5332a4fa-6448-49db-8a3d-d9536baeba40 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] [instance: 9883f029-68a3-4946-b14b-47721b72f3db] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:49.094041 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5332a4fa-6448-49db-8a3d-d9536baeba40 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:49.094538 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5332a4fa-6448-49db-8a3d-d9536baeba40 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:49.095004 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5332a4fa-6448-49db-8a3d-d9536baeba40 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:49.095727 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5332a4fa-6448-49db-8a3d-d9536baeba40 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:49.096181 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5332a4fa-6448-49db-8a3d-d9536baeba40 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:49.096775 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5332a4fa-6448-49db-8a3d-d9536baeba40 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:49.112928 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-5332a4fa-6448-49db-8a3d-d9536baeba40 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] HTTP exception thrown: Instance 9883f029-68a3-4946-b14b-47721b72f3db could not be found. Aug 09 07:03:49.118109 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-5332a4fa-6448-49db-8a3d-d9536baeba40 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Request method failure captured: Aug 09 07:03:49.118109 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db HTTP/1.1 Aug 09 07:03:49.118109 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 09 07:03:49.118109 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 09 07:03:49.118109 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Connection: close Aug 09 07:03:49.118109 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Length: 0 Aug 09 07:03:49.118109 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 09 07:03:49.118109 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.30 Aug 09 07:03:49.118109 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 09 07:03:49.118109 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.11 Aug 09 07:03:49.118109 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi8gaMsOsha7hXaTRNVmyDSBgKNbVizFtjOjNfXYiiMg4_xeqhtayKlp0CbLtOWEmlMmx-tGHxD4rtDEjACmFJWNOL0Nr-GUvUU8t06FpGLCRkp7st-ANjLgf69Y5f5C62HRc9joMlioHxviYlHGkMfLcfI_-y8jcdrIg8YfRzGhu8Q9c Aug 09 07:03:49.118109 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 09 07:03:49.118109 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 09 07:03:49.118109 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 09 07:03:49.118109 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 09 07:03:49.118109 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 09 07:03:49.118109 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 09 07:03:49.118109 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Id: a1b8f338b40e4d7e9a6249084bcdaa73 Aug 09 07:03:49.118109 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-DeleteServersTestJSON-1255412434 Aug 09 07:03:49.118109 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 09 07:03:49.118109 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 09 07:03:49.119837 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a1b8f338b40e4d7e9a6249084bcdaa73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a1b8f338b40e4d7e9a6249084bcdaa73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a1b8f338b40e4d7e9a6249084bcdaa73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a1b8f338b40e4d7e9a6249084bcdaa73"}]}] Aug 09 07:03:49.119837 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-DeleteServersTestJSON-1255412434 Aug 09 07:03:49.119837 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: a1b8f338b40e4d7e9a6249084bcdaa73 Aug 09 07:03:49.119837 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-DeleteServersTestJSON-1255412434 Aug 09 07:03:49.119837 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User: tempest-DeleteServersTestJSON-1255412434-project Aug 09 07:03:49.119837 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 09 07:03:49.119837 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 09 07:03:49.119837 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Id: 20ef078fe46d418c95f35e1f0bdd2f2e Aug 09 07:03:49.119837 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-DeleteServersTestJSON-1255412434-project Aug 09 07:03:49.119837 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: method: > Aug 09 07:03:49.119837 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: exception: Instance 9883f029-68a3-4946-b14b-47721b72f3db could not be found. Aug 09 07:03:49.119837 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: action_args: {'id': '9883f029-68a3-4946-b14b-47721b72f3db'} Aug 09 07:03:49.120692 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 07:03:49.120692 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:03:49.120692 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 07:03:49.120692 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 07:03:49.120692 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 07:03:49.120692 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 07:03:49.120692 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 07:03:49.120692 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 07:03:49.120692 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 07:03:49.120692 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 07:03:49.120692 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9883f029-68a3-4946-b14b-47721b72f3db could not be found. Aug 09 07:03:49.120692 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:03:49.120692 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:03:49.120692 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:03:49.120692 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:03:49.120692 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:03:49.120692 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:03:49.120692 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 07:03:49.120692 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 07:03:49.120692 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 07:03:49.122091 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 07:03:49.122091 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 07:03:49.122091 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 07:03:49.122091 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 07:03:49.122091 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 07:03:49.122091 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 07:03:49.122091 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 07:03:49.122091 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9883f029-68a3-4946-b14b-47721b72f3db could not be found. Aug 09 07:03:49.122091 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:03:49.122091 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:03:49.122091 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:03:49.122091 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:03:49.122091 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:03:49.122091 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:03:49.122091 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 07:03:49.122091 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 07:03:49.122091 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9883f029-68a3-4946-b14b-47721b72f3db could not be found. Aug 09 07:03:49.122091 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:03:49.123481 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-5332a4fa-6448-49db-8a3d-d9536baeba40 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Returning 404 to user: Instance 9883f029-68a3-4946-b14b-47721b72f3db could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 07:03:49.123481 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-5332a4fa-6448-49db-8a3d-d9536baeba40 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] 10.222.0.30 "GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db" status: 404 len: 111 microversion: 2.1 time: 0.039976 Aug 09 07:03:49.123481 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 118/233] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:49 2022] GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 07:03:49.232530 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-f89d5e7f-4c5c-416e-a26d-f12030628fbd tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:49.234806 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-f89d5e7f-4c5c-416e-a26d-f12030628fbd tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] [instance: 9883f029-68a3-4946-b14b-47721b72f3db] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:49.240664 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f89d5e7f-4c5c-416e-a26d-f12030628fbd tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:49.241143 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f89d5e7f-4c5c-416e-a26d-f12030628fbd tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:49.241572 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f89d5e7f-4c5c-416e-a26d-f12030628fbd tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:49.242354 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f89d5e7f-4c5c-416e-a26d-f12030628fbd tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:49.243354 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f89d5e7f-4c5c-416e-a26d-f12030628fbd tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:49.243809 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f89d5e7f-4c5c-416e-a26d-f12030628fbd tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:49.256642 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.wsgi [None req-f89d5e7f-4c5c-416e-a26d-f12030628fbd tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] HTTP exception thrown: Instance 9883f029-68a3-4946-b14b-47721b72f3db could not be found. Aug 09 07:03:49.260773 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-f89d5e7f-4c5c-416e-a26d-f12030628fbd tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Request method failure captured: Aug 09 07:03:49.260773 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: request: GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db/os-volume_attachments HTTP/1.1 Aug 09 07:03:49.260773 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Accept: application/json Aug 09 07:03:49.260773 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Accept-Encoding: identity Aug 09 07:03:49.260773 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Connection: close Aug 09 07:03:49.260773 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Content-Length: 0 Aug 09 07:03:49.260773 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Content-Type: application/json Aug 09 07:03:49.260773 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Host: 10.222.0.30 Aug 09 07:03:49.260773 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Openstack-System-Scope: None Aug 09 07:03:49.260773 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: User-Agent: python-urllib3/1.26.11 Aug 09 07:03:49.260773 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Auth-Token: gAAAAABi8gaMsOsha7hXaTRNVmyDSBgKNbVizFtjOjNfXYiiMg4_xeqhtayKlp0CbLtOWEmlMmx-tGHxD4rtDEjACmFJWNOL0Nr-GUvUU8t06FpGLCRkp7st-ANjLgf69Y5f5C62HRc9joMlioHxviYlHGkMfLcfI_-y8jcdrIg8YfRzGhu8Q9c Aug 09 07:03:49.260773 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Domain-Id: None Aug 09 07:03:49.260773 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Domain-Name: None Aug 09 07:03:49.260773 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Identity-Status: Confirmed Aug 09 07:03:49.260773 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Is-Admin-Project: True Aug 09 07:03:49.260773 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Domain-Id: default Aug 09 07:03:49.260773 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Domain-Name: Default Aug 09 07:03:49.260773 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Id: a1b8f338b40e4d7e9a6249084bcdaa73 Aug 09 07:03:49.260773 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Name: tempest-DeleteServersTestJSON-1255412434 Aug 09 07:03:49.260773 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Role: reader,member Aug 09 07:03:49.260773 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Roles: reader,member Aug 09 07:03:49.262194 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a1b8f338b40e4d7e9a6249084bcdaa73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a1b8f338b40e4d7e9a6249084bcdaa73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a1b8f338b40e4d7e9a6249084bcdaa73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a1b8f338b40e4d7e9a6249084bcdaa73"}]}] Aug 09 07:03:49.262194 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant: tempest-DeleteServersTestJSON-1255412434 Aug 09 07:03:49.262194 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant-Id: a1b8f338b40e4d7e9a6249084bcdaa73 Aug 09 07:03:49.262194 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant-Name: tempest-DeleteServersTestJSON-1255412434 Aug 09 07:03:49.262194 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User: tempest-DeleteServersTestJSON-1255412434-project Aug 09 07:03:49.262194 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Domain-Id: default Aug 09 07:03:49.262194 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Domain-Name: Default Aug 09 07:03:49.262194 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Id: 20ef078fe46d418c95f35e1f0bdd2f2e Aug 09 07:03:49.262194 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Name: tempest-DeleteServersTestJSON-1255412434-project Aug 09 07:03:49.262194 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: method: > Aug 09 07:03:49.262194 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: exception: Instance 9883f029-68a3-4946-b14b-47721b72f3db could not be found. Aug 09 07:03:49.262194 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: action_args: {'server_id': '9883f029-68a3-4946-b14b-47721b72f3db'} Aug 09 07:03:49.262980 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 07:03:49.262980 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:03:49.262980 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 07:03:49.262980 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 07:03:49.262980 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 07:03:49.262980 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 07:03:49.262980 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 07:03:49.262980 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 07:03:49.262980 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 07:03:49.262980 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 07:03:49.262980 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9883f029-68a3-4946-b14b-47721b72f3db could not be found. Aug 09 07:03:49.262980 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:03:49.262980 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:03:49.262980 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:03:49.262980 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:03:49.262980 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:03:49.262980 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:03:49.262980 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 07:03:49.262980 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 07:03:49.262980 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 07:03:49.264312 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 07:03:49.264312 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 07:03:49.264312 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 07:03:49.264312 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 09 07:03:49.264312 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 07:03:49.264312 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 09 07:03:49.264312 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 09 07:03:49.264312 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 07:03:49.264312 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 07:03:49.264312 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9883f029-68a3-4946-b14b-47721b72f3db could not be found. Aug 09 07:03:49.264312 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:03:49.264312 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:03:49.264312 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:03:49.264312 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:03:49.264312 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:03:49.264312 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:03:49.264312 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 07:03:49.264312 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 07:03:49.264312 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9883f029-68a3-4946-b14b-47721b72f3db could not be found. Aug 09 07:03:49.264312 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:03:49.265581 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-f89d5e7f-4c5c-416e-a26d-f12030628fbd tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Returning 404 to user: Instance 9883f029-68a3-4946-b14b-47721b72f3db could not be found. {{(pid=117858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 07:03:49.265581 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-f89d5e7f-4c5c-416e-a26d-f12030628fbd tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] 10.222.0.30 "GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033607 Aug 09 07:03:49.265581 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 116/234] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 9 07:03:49 2022] GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 07:03:50.099285 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-8ac5548e-75b1-4f5b-923f-141bcbcbe0c0 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:50.099917 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-8ac5548e-75b1-4f5b-923f-141bcbcbe0c0 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] [instance: 7240387f-c724-4ecb-9c26-d58666857ddf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:50.103015 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-ce308e09-a79f-4714-b22c-bdc4b5910e84 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:50.103659 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-ce308e09-a79f-4714-b22c-bdc4b5910e84 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:50.105579 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:50.106521 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8ac5548e-75b1-4f5b-923f-141bcbcbe0c0 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:50.107050 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8ac5548e-75b1-4f5b-923f-141bcbcbe0c0 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:50.107481 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8ac5548e-75b1-4f5b-923f-141bcbcbe0c0 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:50.108209 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8ac5548e-75b1-4f5b-923f-141bcbcbe0c0 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:50.108661 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8ac5548e-75b1-4f5b-923f-141bcbcbe0c0 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:50.109075 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8ac5548e-75b1-4f5b-923f-141bcbcbe0c0 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:50.111400 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ce308e09-a79f-4714-b22c-bdc4b5910e84 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:50.111948 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ce308e09-a79f-4714-b22c-bdc4b5910e84 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:50.112337 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ce308e09-a79f-4714-b22c-bdc4b5910e84 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:50.113029 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ce308e09-a79f-4714-b22c-bdc4b5910e84 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:50.113508 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ce308e09-a79f-4714-b22c-bdc4b5910e84 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:50.113928 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ce308e09-a79f-4714-b22c-bdc4b5910e84 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:50.309264 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8ac5548e-75b1-4f5b-923f-141bcbcbe0c0 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6b55d7cb1840a5ad93369589a36596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814c528dd56c4e61ae5cba5733bf2f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:50.315805 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-ce308e09-a79f-4714-b22c-bdc4b5910e84 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:50.317374 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-8ac5548e-75b1-4f5b-923f-141bcbcbe0c0 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] 10.222.0.30 "GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf" status: 200 len: 1314 microversion: 2.1 time: 0.221946 Aug 09 07:03:50.318217 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 119/235] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:50 2022] GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:50.324313 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-ce308e09-a79f-4714-b22c-bdc4b5910e84 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 200 len: 1521 microversion: 2.1 time: 0.225971 Aug 09 07:03:50.324866 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 117/236] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:50 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:03:51.338725 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-aca3c683-702e-44ab-9bc9-0047d9c56185 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:51.339334 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-aca3c683-702e-44ab-9bc9-0047d9c56185 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] [instance: 7240387f-c724-4ecb-9c26-d58666857ddf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:51.345210 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-b8d1e2e5-1a60-446c-9de7-e872af02873b tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:51.345819 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-b8d1e2e5-1a60-446c-9de7-e872af02873b tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:51.345926 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aca3c683-702e-44ab-9bc9-0047d9c56185 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:51.346338 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aca3c683-702e-44ab-9bc9-0047d9c56185 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:51.346767 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aca3c683-702e-44ab-9bc9-0047d9c56185 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:51.347447 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aca3c683-702e-44ab-9bc9-0047d9c56185 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:51.347936 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aca3c683-702e-44ab-9bc9-0047d9c56185 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:51.348352 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aca3c683-702e-44ab-9bc9-0047d9c56185 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:51.352363 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b8d1e2e5-1a60-446c-9de7-e872af02873b tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:51.352914 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b8d1e2e5-1a60-446c-9de7-e872af02873b tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:51.353345 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b8d1e2e5-1a60-446c-9de7-e872af02873b tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:51.354035 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b8d1e2e5-1a60-446c-9de7-e872af02873b tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:51.354487 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b8d1e2e5-1a60-446c-9de7-e872af02873b tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:51.354909 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b8d1e2e5-1a60-446c-9de7-e872af02873b tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:51.542785 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-aca3c683-702e-44ab-9bc9-0047d9c56185 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6b55d7cb1840a5ad93369589a36596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814c528dd56c4e61ae5cba5733bf2f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:51.549675 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-b8d1e2e5-1a60-446c-9de7-e872af02873b tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:51.550119 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-aca3c683-702e-44ab-9bc9-0047d9c56185 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] 10.222.0.30 "GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf" status: 200 len: 1314 microversion: 2.1 time: 0.215802 Aug 09 07:03:51.550692 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 120/237] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:51 2022] GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:51.557315 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-b8d1e2e5-1a60-446c-9de7-e872af02873b tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 200 len: 1521 microversion: 2.1 time: 0.215901 Aug 09 07:03:51.557870 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 118/238] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:51 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:03:52.572349 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-80538013-8ce6-484c-a191-104631aab382 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:52.573238 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-80538013-8ce6-484c-a191-104631aab382 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] [instance: 7240387f-c724-4ecb-9c26-d58666857ddf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:52.578235 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-fa96928b-c4ee-48b2-ac95-4d02e0adca76 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:52.578913 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-fa96928b-c4ee-48b2-ac95-4d02e0adca76 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:52.580704 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-80538013-8ce6-484c-a191-104631aab382 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:52.581056 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-80538013-8ce6-484c-a191-104631aab382 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:52.581553 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-80538013-8ce6-484c-a191-104631aab382 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:52.591320 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-80538013-8ce6-484c-a191-104631aab382 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:52.592037 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-80538013-8ce6-484c-a191-104631aab382 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:52.592763 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-80538013-8ce6-484c-a191-104631aab382 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:52.601081 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-fa96928b-c4ee-48b2-ac95-4d02e0adca76 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:52.601580 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-fa96928b-c4ee-48b2-ac95-4d02e0adca76 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:52.602557 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-fa96928b-c4ee-48b2-ac95-4d02e0adca76 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:52.603502 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-fa96928b-c4ee-48b2-ac95-4d02e0adca76 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:52.603810 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-fa96928b-c4ee-48b2-ac95-4d02e0adca76 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:52.604274 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-fa96928b-c4ee-48b2-ac95-4d02e0adca76 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:52.609999 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=100 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:52.616787 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:52.800736 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-80538013-8ce6-484c-a191-104631aab382 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6b55d7cb1840a5ad93369589a36596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814c528dd56c4e61ae5cba5733bf2f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:52.809326 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-80538013-8ce6-484c-a191-104631aab382 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] 10.222.0.30 "GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf" status: 200 len: 1314 microversion: 2.1 time: 0.242027 Aug 09 07:03:52.810251 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 121/239] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:52 2022] GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:52.815319 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-f499c4eb-501a-4f94-8e31-8bae777b58cd req-ba169234-916e-41ea-940f-409a234e778b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7240387f-c724-4ecb-9c26-d58666857ddf", "name": "network-vif-plugged", "status": "completed", "tag": "be1a1b6c-36b3-4e80-8755-5e36c38bee83"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:03:52.825418 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-f499c4eb-501a-4f94-8e31-8bae777b58cd req-ba169234-916e-41ea-940f-409a234e778b service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:52.826174 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-f499c4eb-501a-4f94-8e31-8bae777b58cd req-ba169234-916e-41ea-940f-409a234e778b service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:52.826715 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-f499c4eb-501a-4f94-8e31-8bae777b58cd req-ba169234-916e-41ea-940f-409a234e778b service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:52.844903 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-f499c4eb-501a-4f94-8e31-8bae777b58cd req-ba169234-916e-41ea-940f-409a234e778b service nova] Creating event network-vif-plugged:be1a1b6c-36b3-4e80-8755-5e36c38bee83 for instance 7240387f-c724-4ecb-9c26-d58666857ddf on hv-cinder-85251 Aug 09 07:03:52.845101 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-fa96928b-c4ee-48b2-ac95-4d02e0adca76 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:52.851547 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-f499c4eb-501a-4f94-8e31-8bae777b58cd req-ba169234-916e-41ea-940f-409a234e778b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039973 Aug 09 07:03:52.853287 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-fa96928b-c4ee-48b2-ac95-4d02e0adca76 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 200 len: 1521 microversion: 2.1 time: 0.279134 Aug 09 07:03:52.853426 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 122/240] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:03:52.854132 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 119/241] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:52 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:53.660066 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6ef9c829-ce18-4e56-8d20-11206899658a tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:53.660642 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-6ef9c829-ce18-4e56-8d20-11206899658a tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] [instance: 9883f029-68a3-4946-b14b-47721b72f3db] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:53.669604 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6ef9c829-ce18-4e56-8d20-11206899658a tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:53.670088 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6ef9c829-ce18-4e56-8d20-11206899658a tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:53.670693 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6ef9c829-ce18-4e56-8d20-11206899658a tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:53.673174 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6ef9c829-ce18-4e56-8d20-11206899658a tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:53.673655 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6ef9c829-ce18-4e56-8d20-11206899658a tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:53.674084 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6ef9c829-ce18-4e56-8d20-11206899658a tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:53.688092 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-6ef9c829-ce18-4e56-8d20-11206899658a tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] HTTP exception thrown: Instance 9883f029-68a3-4946-b14b-47721b72f3db could not be found. Aug 09 07:03:53.689721 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6ef9c829-ce18-4e56-8d20-11206899658a tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Request method failure captured: Aug 09 07:03:53.689721 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: request: DELETE /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db HTTP/1.1 Aug 09 07:03:53.689721 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 09 07:03:53.689721 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 09 07:03:53.689721 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Connection: close Aug 09 07:03:53.689721 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Length: 0 Aug 09 07:03:53.689721 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 09 07:03:53.689721 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.30 Aug 09 07:03:53.689721 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 09 07:03:53.689721 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.11 Aug 09 07:03:53.689721 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi8gaMsOsha7hXaTRNVmyDSBgKNbVizFtjOjNfXYiiMg4_xeqhtayKlp0CbLtOWEmlMmx-tGHxD4rtDEjACmFJWNOL0Nr-GUvUU8t06FpGLCRkp7st-ANjLgf69Y5f5C62HRc9joMlioHxviYlHGkMfLcfI_-y8jcdrIg8YfRzGhu8Q9c Aug 09 07:03:53.689721 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 09 07:03:53.689721 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 09 07:03:53.689721 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 09 07:03:53.689721 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 09 07:03:53.689721 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 09 07:03:53.689721 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 09 07:03:53.689721 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Id: a1b8f338b40e4d7e9a6249084bcdaa73 Aug 09 07:03:53.689721 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-DeleteServersTestJSON-1255412434 Aug 09 07:03:53.689721 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 09 07:03:53.689721 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 09 07:03:53.691121 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a1b8f338b40e4d7e9a6249084bcdaa73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a1b8f338b40e4d7e9a6249084bcdaa73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a1b8f338b40e4d7e9a6249084bcdaa73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a1b8f338b40e4d7e9a6249084bcdaa73"}]}] Aug 09 07:03:53.691121 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-DeleteServersTestJSON-1255412434 Aug 09 07:03:53.691121 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: a1b8f338b40e4d7e9a6249084bcdaa73 Aug 09 07:03:53.691121 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-DeleteServersTestJSON-1255412434 Aug 09 07:03:53.691121 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User: tempest-DeleteServersTestJSON-1255412434-project Aug 09 07:03:53.691121 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 09 07:03:53.691121 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 09 07:03:53.691121 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Id: 20ef078fe46d418c95f35e1f0bdd2f2e Aug 09 07:03:53.691121 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-DeleteServersTestJSON-1255412434-project Aug 09 07:03:53.691121 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: method: > Aug 09 07:03:53.691121 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: exception: Instance 9883f029-68a3-4946-b14b-47721b72f3db could not be found. Aug 09 07:03:53.691121 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: action_args: {'id': '9883f029-68a3-4946-b14b-47721b72f3db'} Aug 09 07:03:53.692032 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 07:03:53.692032 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:03:53.692032 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 07:03:53.692032 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 07:03:53.692032 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 07:03:53.692032 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 07:03:53.692032 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 07:03:53.692032 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 07:03:53.692032 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 07:03:53.692032 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 07:03:53.692032 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9883f029-68a3-4946-b14b-47721b72f3db could not be found. Aug 09 07:03:53.692032 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:03:53.692032 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:03:53.692032 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:03:53.692032 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:03:53.692032 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:03:53.692032 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:03:53.692032 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 07:03:53.692032 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 07:03:53.692032 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 07:03:53.693120 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 07:03:53.693120 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 07:03:53.693120 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 07:03:53.693120 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 07:03:53.693120 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 07:03:53.693120 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 07:03:53.693120 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 07:03:53.693120 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 07:03:53.693120 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 07:03:53.693120 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9883f029-68a3-4946-b14b-47721b72f3db could not be found. Aug 09 07:03:53.693120 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:03:53.693120 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:03:53.693120 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:03:53.693120 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:03:53.693120 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:03:53.693120 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:03:53.693120 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 07:03:53.693120 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 07:03:53.693120 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9883f029-68a3-4946-b14b-47721b72f3db could not be found. Aug 09 07:03:53.693120 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:03:53.694257 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6ef9c829-ce18-4e56-8d20-11206899658a tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Returning 404 to user: Instance 9883f029-68a3-4946-b14b-47721b72f3db could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 07:03:53.694257 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-6ef9c829-ce18-4e56-8d20-11206899658a tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db" status: 404 len: 111 microversion: 2.1 time: 0.037167 Aug 09 07:03:53.694257 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 123/242] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 9 07:03:53 2022] DELETE /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 07:03:53.700586 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-da50f576-9944-4447-a197-6452fc7844a2 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:53.701178 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-da50f576-9944-4447-a197-6452fc7844a2 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] [instance: 9883f029-68a3-4946-b14b-47721b72f3db] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:53.706854 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-da50f576-9944-4447-a197-6452fc7844a2 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:53.707330 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-da50f576-9944-4447-a197-6452fc7844a2 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:53.707795 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-da50f576-9944-4447-a197-6452fc7844a2 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:53.708469 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-da50f576-9944-4447-a197-6452fc7844a2 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:53.708912 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-da50f576-9944-4447-a197-6452fc7844a2 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:53.709329 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-da50f576-9944-4447-a197-6452fc7844a2 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:53.722525 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.wsgi [None req-da50f576-9944-4447-a197-6452fc7844a2 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] HTTP exception thrown: Instance 9883f029-68a3-4946-b14b-47721b72f3db could not be found. Aug 09 07:03:53.724619 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-da50f576-9944-4447-a197-6452fc7844a2 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Request method failure captured: Aug 09 07:03:53.724619 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: request: GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db HTTP/1.1 Aug 09 07:03:53.724619 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Accept: application/json Aug 09 07:03:53.724619 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Accept-Encoding: identity Aug 09 07:03:53.724619 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Connection: close Aug 09 07:03:53.724619 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Content-Length: 0 Aug 09 07:03:53.724619 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Content-Type: application/json Aug 09 07:03:53.724619 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Host: 10.222.0.30 Aug 09 07:03:53.724619 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Openstack-System-Scope: None Aug 09 07:03:53.724619 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: User-Agent: python-urllib3/1.26.11 Aug 09 07:03:53.724619 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Auth-Token: gAAAAABi8gaMsOsha7hXaTRNVmyDSBgKNbVizFtjOjNfXYiiMg4_xeqhtayKlp0CbLtOWEmlMmx-tGHxD4rtDEjACmFJWNOL0Nr-GUvUU8t06FpGLCRkp7st-ANjLgf69Y5f5C62HRc9joMlioHxviYlHGkMfLcfI_-y8jcdrIg8YfRzGhu8Q9c Aug 09 07:03:53.724619 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Domain-Id: None Aug 09 07:03:53.724619 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Domain-Name: None Aug 09 07:03:53.724619 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Identity-Status: Confirmed Aug 09 07:03:53.724619 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Is-Admin-Project: True Aug 09 07:03:53.724619 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Domain-Id: default Aug 09 07:03:53.724619 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Domain-Name: Default Aug 09 07:03:53.724619 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Id: a1b8f338b40e4d7e9a6249084bcdaa73 Aug 09 07:03:53.724619 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Name: tempest-DeleteServersTestJSON-1255412434 Aug 09 07:03:53.724619 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Role: reader,member Aug 09 07:03:53.724619 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Roles: reader,member Aug 09 07:03:53.726058 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a1b8f338b40e4d7e9a6249084bcdaa73"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_a1b8f338b40e4d7e9a6249084bcdaa73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/a1b8f338b40e4d7e9a6249084bcdaa73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/a1b8f338b40e4d7e9a6249084bcdaa73"}]}] Aug 09 07:03:53.726058 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant: tempest-DeleteServersTestJSON-1255412434 Aug 09 07:03:53.726058 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant-Id: a1b8f338b40e4d7e9a6249084bcdaa73 Aug 09 07:03:53.726058 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant-Name: tempest-DeleteServersTestJSON-1255412434 Aug 09 07:03:53.726058 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User: tempest-DeleteServersTestJSON-1255412434-project Aug 09 07:03:53.726058 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Domain-Id: default Aug 09 07:03:53.726058 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Domain-Name: Default Aug 09 07:03:53.726058 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Id: 20ef078fe46d418c95f35e1f0bdd2f2e Aug 09 07:03:53.726058 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Name: tempest-DeleteServersTestJSON-1255412434-project Aug 09 07:03:53.726058 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: method: > Aug 09 07:03:53.726058 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: exception: Instance 9883f029-68a3-4946-b14b-47721b72f3db could not be found. Aug 09 07:03:53.726058 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: action_args: {'id': '9883f029-68a3-4946-b14b-47721b72f3db'} Aug 09 07:03:53.727966 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 07:03:53.727966 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:03:53.727966 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 07:03:53.727966 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 07:03:53.727966 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 07:03:53.727966 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 07:03:53.727966 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 07:03:53.727966 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 07:03:53.727966 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 07:03:53.727966 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 07:03:53.727966 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9883f029-68a3-4946-b14b-47721b72f3db could not be found. Aug 09 07:03:53.727966 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:03:53.727966 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:03:53.727966 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:03:53.727966 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:03:53.727966 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:03:53.727966 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:03:53.727966 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 07:03:53.727966 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 07:03:53.727966 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 07:03:53.729038 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 07:03:53.729038 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 07:03:53.729038 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 07:03:53.729038 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 07:03:53.729038 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 07:03:53.729038 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 07:03:53.729038 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 07:03:53.729038 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9883f029-68a3-4946-b14b-47721b72f3db could not be found. Aug 09 07:03:53.729038 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:03:53.729038 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:03:53.729038 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:03:53.729038 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:03:53.729038 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:03:53.729038 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:03:53.729038 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 07:03:53.729038 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 07:03:53.729038 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9883f029-68a3-4946-b14b-47721b72f3db could not be found. Aug 09 07:03:53.729038 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:03:53.729969 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-da50f576-9944-4447-a197-6452fc7844a2 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] Returning 404 to user: Instance 9883f029-68a3-4946-b14b-47721b72f3db could not be found. {{(pid=117858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 07:03:53.729969 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-da50f576-9944-4447-a197-6452fc7844a2 tempest-DeleteServersTestJSON-1255412434 tempest-DeleteServersTestJSON-1255412434-project] 10.222.0.30 "GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db" status: 404 len: 111 microversion: 2.1 time: 0.029361 Aug 09 07:03:53.729969 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 120/243] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:53 2022] GET /compute/v2.1/servers/9883f029-68a3-4946-b14b-47721b72f3db => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 07:03:53.832458 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2fb23f95-b756-47aa-9c37-3783fe3a873e tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:53.833071 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-2fb23f95-b756-47aa-9c37-3783fe3a873e tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] [instance: 7240387f-c724-4ecb-9c26-d58666857ddf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:53.847142 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2fb23f95-b756-47aa-9c37-3783fe3a873e tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:53.848032 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2fb23f95-b756-47aa-9c37-3783fe3a873e tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:53.848607 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2fb23f95-b756-47aa-9c37-3783fe3a873e tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:53.849498 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2fb23f95-b756-47aa-9c37-3783fe3a873e tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:53.850534 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2fb23f95-b756-47aa-9c37-3783fe3a873e tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:53.850534 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2fb23f95-b756-47aa-9c37-3783fe3a873e tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:53.874653 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-655096f3-1455-499b-9bec-b5c46a791399 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:53.875408 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-655096f3-1455-499b-9bec-b5c46a791399 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:53.885757 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-655096f3-1455-499b-9bec-b5c46a791399 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:53.886087 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-655096f3-1455-499b-9bec-b5c46a791399 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:53.890293 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-655096f3-1455-499b-9bec-b5c46a791399 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:53.891032 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-655096f3-1455-499b-9bec-b5c46a791399 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:53.891494 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-655096f3-1455-499b-9bec-b5c46a791399 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:53.892144 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-655096f3-1455-499b-9bec-b5c46a791399 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:54.134936 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2fb23f95-b756-47aa-9c37-3783fe3a873e tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6b55d7cb1840a5ad93369589a36596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814c528dd56c4e61ae5cba5733bf2f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:54.142381 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-2fb23f95-b756-47aa-9c37-3783fe3a873e tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] 10.222.0.30 "GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf" status: 200 len: 1314 microversion: 2.1 time: 0.313779 Aug 09 07:03:54.142946 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 124/244] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:53 2022] GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:54.198180 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-655096f3-1455-499b-9bec-b5c46a791399 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:54.205669 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-655096f3-1455-499b-9bec-b5c46a791399 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 200 len: 1521 microversion: 2.1 time: 0.335002 Aug 09 07:03:54.206324 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 121/245] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:53 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 1521 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:55.169153 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a6a9c4e7-f266-49f8-b35e-318ffc55554b tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:55.171825 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-a6a9c4e7-f266-49f8-b35e-318ffc55554b tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] [instance: 7240387f-c724-4ecb-9c26-d58666857ddf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:55.178696 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a6a9c4e7-f266-49f8-b35e-318ffc55554b tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:55.179544 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a6a9c4e7-f266-49f8-b35e-318ffc55554b tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:55.180187 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a6a9c4e7-f266-49f8-b35e-318ffc55554b tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:55.181543 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a6a9c4e7-f266-49f8-b35e-318ffc55554b tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:55.182166 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a6a9c4e7-f266-49f8-b35e-318ffc55554b tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:55.182599 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a6a9c4e7-f266-49f8-b35e-318ffc55554b tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:55.228683 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-2ac921ae-c954-4406-93cf-d909bba99737 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:55.230471 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-2ac921ae-c954-4406-93cf-d909bba99737 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:55.238477 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2ac921ae-c954-4406-93cf-d909bba99737 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:55.238970 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2ac921ae-c954-4406-93cf-d909bba99737 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:55.239405 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2ac921ae-c954-4406-93cf-d909bba99737 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:55.243973 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2ac921ae-c954-4406-93cf-d909bba99737 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:55.244463 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2ac921ae-c954-4406-93cf-d909bba99737 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:55.244906 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2ac921ae-c954-4406-93cf-d909bba99737 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:55.619401 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-a6a9c4e7-f266-49f8-b35e-318ffc55554b tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6b55d7cb1840a5ad93369589a36596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814c528dd56c4e61ae5cba5733bf2f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:55.626788 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-a6a9c4e7-f266-49f8-b35e-318ffc55554b tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] 10.222.0.30 "GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf" status: 200 len: 1314 microversion: 2.1 time: 0.466720 Aug 09 07:03:55.627362 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 125/246] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:55 2022] GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf => generated 1314 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:55.643684 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-2ac921ae-c954-4406-93cf-d909bba99737 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:55.652025 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-2ac921ae-c954-4406-93cf-d909bba99737 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 200 len: 1521 microversion: 2.1 time: 0.429526 Aug 09 07:03:55.652581 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 122/247] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:55 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 1521 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:56.649452 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-1ccef408-e1fc-486d-8ca2-24826effc4c0 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:56.650680 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-1ccef408-e1fc-486d-8ca2-24826effc4c0 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] [instance: 7240387f-c724-4ecb-9c26-d58666857ddf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:56.659831 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1ccef408-e1fc-486d-8ca2-24826effc4c0 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:56.660673 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1ccef408-e1fc-486d-8ca2-24826effc4c0 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:56.661483 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1ccef408-e1fc-486d-8ca2-24826effc4c0 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:56.663480 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1ccef408-e1fc-486d-8ca2-24826effc4c0 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:56.665019 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1ccef408-e1fc-486d-8ca2-24826effc4c0 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:56.665585 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1ccef408-e1fc-486d-8ca2-24826effc4c0 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:56.676491 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-ae648bc8-f0fe-4e47-83a8-f822da4b1cf9 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:56.678171 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-ae648bc8-f0fe-4e47-83a8-f822da4b1cf9 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:56.697473 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ae648bc8-f0fe-4e47-83a8-f822da4b1cf9 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:56.698340 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ae648bc8-f0fe-4e47-83a8-f822da4b1cf9 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:56.699007 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ae648bc8-f0fe-4e47-83a8-f822da4b1cf9 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:56.701210 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ae648bc8-f0fe-4e47-83a8-f822da4b1cf9 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:56.701899 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ae648bc8-f0fe-4e47-83a8-f822da4b1cf9 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:56.703801 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ae648bc8-f0fe-4e47-83a8-f822da4b1cf9 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:56.954576 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-ae648bc8-f0fe-4e47-83a8-f822da4b1cf9 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:56.962984 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-ae648bc8-f0fe-4e47-83a8-f822da4b1cf9 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 200 len: 1521 microversion: 2.1 time: 0.293294 Aug 09 07:03:56.963643 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 123/248] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:56 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 1521 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:57.041922 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-1ccef408-e1fc-486d-8ca2-24826effc4c0 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6b55d7cb1840a5ad93369589a36596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814c528dd56c4e61ae5cba5733bf2f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:57.049299 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-1ccef408-e1fc-486d-8ca2-24826effc4c0 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] 10.222.0.30 "GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf" status: 200 len: 1314 microversion: 2.1 time: 0.404466 Aug 09 07:03:57.049865 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 126/249] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:56 2022] GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf => generated 1314 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:57.997293 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-aeb0f699-4c85-4486-a850-8a228e7e6ec8 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:57.998737 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-aeb0f699-4c85-4486-a850-8a228e7e6ec8 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:58.006063 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-aeb0f699-4c85-4486-a850-8a228e7e6ec8 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:58.006856 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-aeb0f699-4c85-4486-a850-8a228e7e6ec8 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:58.007521 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-aeb0f699-4c85-4486-a850-8a228e7e6ec8 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:58.008662 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-aeb0f699-4c85-4486-a850-8a228e7e6ec8 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:58.009237 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-aeb0f699-4c85-4486-a850-8a228e7e6ec8 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:58.009736 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-aeb0f699-4c85-4486-a850-8a228e7e6ec8 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:58.049130 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6ae7318a-64ce-408c-ba91-723e1b829d75 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-781227096", "imageRef": "5d2c35cc-2f3b-4a22-bd68-79c71882b6a2", "flavorRef": "452"}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:03:58.150735 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.network.neutron [None req-6ae7318a-64ce-408c-ba91-723e1b829d75 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] validate_networks() for None {{(pid=117859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 07:03:58.580318 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-aeb0f699-4c85-4486-a850-8a228e7e6ec8 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:58.589213 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-aeb0f699-4c85-4486-a850-8a228e7e6ec8 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 200 len: 1521 microversion: 2.1 time: 0.607457 Aug 09 07:03:58.589790 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 124/250] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:57 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 1521 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:58.599261 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-86aea453-404a-49a3-9fe1-c1f5d6bfa22b tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:58.599261 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-86aea453-404a-49a3-9fe1-c1f5d6bfa22b tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] [instance: 7240387f-c724-4ecb-9c26-d58666857ddf] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:58.603041 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-86aea453-404a-49a3-9fe1-c1f5d6bfa22b tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:58.604187 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-86aea453-404a-49a3-9fe1-c1f5d6bfa22b tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:58.604844 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-86aea453-404a-49a3-9fe1-c1f5d6bfa22b tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:58.605886 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-86aea453-404a-49a3-9fe1-c1f5d6bfa22b tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:58.606562 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-86aea453-404a-49a3-9fe1-c1f5d6bfa22b tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:58.606964 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-86aea453-404a-49a3-9fe1-c1f5d6bfa22b tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:58.812810 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-6ae7318a-64ce-408c-ba91-723e1b829d75 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Flavor limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 07:03:58.813285 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-6ae7318a-64ce-408c-ba91-723e1b829d75 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Image limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 07:03:58.813769 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-6ae7318a-64ce-408c-ba91-723e1b829d75 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Flavor pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 07:03:58.814178 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-6ae7318a-64ce-408c-ba91-723e1b829d75 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Image pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 07:03:58.814594 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-6ae7318a-64ce-408c-ba91-723e1b829d75 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 07:03:58.825219 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6ae7318a-64ce-408c-ba91-723e1b829d75 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:58.825802 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6ae7318a-64ce-408c-ba91-723e1b829d75 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:58.826338 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6ae7318a-64ce-408c-ba91-723e1b829d75 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:58.826846 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-86aea453-404a-49a3-9fe1-c1f5d6bfa22b tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6b55d7cb1840a5ad93369589a36596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814c528dd56c4e61ae5cba5733bf2f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:58.827702 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6ae7318a-64ce-408c-ba91-723e1b829d75 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:58.828319 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6ae7318a-64ce-408c-ba91-723e1b829d75 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:58.828742 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6ae7318a-64ce-408c-ba91-723e1b829d75 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:58.834887 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-86aea453-404a-49a3-9fe1-c1f5d6bfa22b tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] 10.222.0.30 "GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf" status: 200 len: 1497 microversion: 2.1 time: 0.244113 Aug 09 07:03:58.836785 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 125/251] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:58 2022] GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf => generated 1497 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:58.853644 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-6ae7318a-64ce-408c-ba91-723e1b829d75 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Getting quotas for project 8c78ed6f8b354b1b9b07151736df1386. Resources: {'cores', 'instances', 'ram'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 07:03:58.857682 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-6ae7318a-64ce-408c-ba91-723e1b829d75 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Getting quotas for user 3e146e6da0294fa78e07d8c1e971af3e and project 8c78ed6f8b354b1b9b07151736df1386. Resources: {'cores', 'instances', 'ram'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 07:03:58.871836 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-6ae7318a-64ce-408c-ba91-723e1b829d75 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Going to run 1 instances... {{(pid=117859) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 07:03:58.874113 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-6ae7318a-64ce-408c-ba91-723e1b829d75 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] [instance: b756c8c1-b4b0-4d12-97f6-6c229a956b28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5d2c35cc-2f3b-4a22-bd68-79c71882b6a2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 07:03:58.921396 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-6ae7318a-64ce-408c-ba91-723e1b829d75 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.876754 Aug 09 07:03:58.921966 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 127/252] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 9 07:03:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 878 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 07:03:58.934161 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-a2fdb051-ff47-48ef-82cb-e88264f5326d tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:58.934784 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-a2fdb051-ff47-48ef-82cb-e88264f5326d tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] [instance: b756c8c1-b4b0-4d12-97f6-6c229a956b28] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:58.992720 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-a2fdb051-ff47-48ef-82cb-e88264f5326d tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e146e6da0294fa78e07d8c1e971af3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c78ed6f8b354b1b9b07151736df1386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:59.000744 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-a2fdb051-ff47-48ef-82cb-e88264f5326d tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] 10.222.0.30 "GET /compute/v2.1/servers/b756c8c1-b4b0-4d12-97f6-6c229a956b28" status: 200 len: 1214 microversion: 2.1 time: 0.070716 Aug 09 07:03:59.002077 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 126/253] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:58 2022] GET /compute/v2.1/servers/b756c8c1-b4b0-4d12-97f6-6c229a956b28 => generated 1214 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:59.330554 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e1822166-a6f6-4435-ae39-702d01b46f13 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:59.331695 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-e1822166-a6f6-4435-ae39-702d01b46f13 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] [instance: 7240387f-c724-4ecb-9c26-d58666857ddf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:59.334713 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:03:59.342579 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e1822166-a6f6-4435-ae39-702d01b46f13 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:59.348021 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e1822166-a6f6-4435-ae39-702d01b46f13 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:59.348551 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e1822166-a6f6-4435-ae39-702d01b46f13 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:59.349246 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e1822166-a6f6-4435-ae39-702d01b46f13 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:59.349706 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e1822166-a6f6-4435-ae39-702d01b46f13 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:59.350121 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e1822166-a6f6-4435-ae39-702d01b46f13 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:59.378557 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-e1822166-a6f6-4435-ae39-702d01b46f13 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] [instance: 7240387f-c724-4ecb-9c26-d58666857ddf] Going to try to terminate instance {{(pid=117859) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 07:03:59.473108 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-fbba246c-99c8-4919-9242-3890d8ee88ba tempest-VolumesGetTestJSON-927651953 tempest-VolumesGetTestJSON-927651953-project] Action: 'create', calling method: .version_select at 0x7f20ddd5d550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1493779719", "metadata": {"Type": "work"}}} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:03:59.477658 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-e1822166-a6f6-4435-ae39-702d01b46f13 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf" status: 204 len: 0 microversion: 2.1 time: 0.150977 Aug 09 07:03:59.478557 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 128/254] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 9 07:03:59 2022] DELETE /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 07:03:59.489961 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a1ea2a96-f11f-4944-a012-894d84098d57 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:59.490754 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-a1ea2a96-f11f-4944-a012-894d84098d57 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] [instance: 7240387f-c724-4ecb-9c26-d58666857ddf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:59.498378 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a1ea2a96-f11f-4944-a012-894d84098d57 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:59.498844 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a1ea2a96-f11f-4944-a012-894d84098d57 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:59.499148 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a1ea2a96-f11f-4944-a012-894d84098d57 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:59.499871 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a1ea2a96-f11f-4944-a012-894d84098d57 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:59.500337 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a1ea2a96-f11f-4944-a012-894d84098d57 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:59.500757 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a1ea2a96-f11f-4944-a012-894d84098d57 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:59.655992 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-a1ea2a96-f11f-4944-a012-894d84098d57 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6b55d7cb1840a5ad93369589a36596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814c528dd56c4e61ae5cba5733bf2f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:59.669372 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-a1ea2a96-f11f-4944-a012-894d84098d57 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] 10.222.0.30 "GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf" status: 200 len: 1503 microversion: 2.1 time: 0.184038 Aug 09 07:03:59.669942 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 129/255] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:59 2022] GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf => generated 1503 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:59.675121 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-77efc102-4919-4d9d-be05-73de8a6b3123 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:59.675743 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-77efc102-4919-4d9d-be05-73de8a6b3123 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:03:59.682438 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-77efc102-4919-4d9d-be05-73de8a6b3123 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:59.682914 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-77efc102-4919-4d9d-be05-73de8a6b3123 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:59.683509 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-77efc102-4919-4d9d-be05-73de8a6b3123 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:59.684369 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-77efc102-4919-4d9d-be05-73de8a6b3123 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:03:59.685130 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-77efc102-4919-4d9d-be05-73de8a6b3123 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:03:59.685936 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-77efc102-4919-4d9d-be05-73de8a6b3123 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:03:59.832910 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-77efc102-4919-4d9d-be05-73de8a6b3123 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:03:59.837057 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-fbba246c-99c8-4919-9242-3890d8ee88ba tempest-VolumesGetTestJSON-927651953 tempest-VolumesGetTestJSON-927651953-project] 10.222.0.30 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.492939 Aug 09 07:03:59.837681 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 127/256] 10.222.0.30 () {60 vars in 1156 bytes} [Tue Aug 9 07:03:59 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 494 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 09 07:03:59.849961 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-77efc102-4919-4d9d-be05-73de8a6b3123 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 200 len: 1521 microversion: 2.1 time: 0.178683 Aug 09 07:03:59.850550 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 130/257] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:03:59 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:03:59.851038 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-9c94d3ab-7051-42dc-a57c-0788139e80fe tempest-VolumesGetTestJSON-927651953 tempest-VolumesGetTestJSON-927651953-project] Calling method '.version_select at 0x7f20ddd695e0>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:03:59.902284 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-9c94d3ab-7051-42dc-a57c-0788139e80fe tempest-VolumesGetTestJSON-927651953 tempest-VolumesGetTestJSON-927651953-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/bf436520-1832-41dc-b754-8d27d4b44434" status: 200 len: 353 microversion: 2.1 time: 0.055179 Aug 09 07:03:59.902915 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 128/258] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Aug 9 07:03:59 2022] GET /compute/v2.1/os-volumes/bf436520-1832-41dc-b754-8d27d4b44434 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:04:00.022777 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b5a65091-1511-4263-8fd2-56a7a304a8c4 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:00.023715 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b5a65091-1511-4263-8fd2-56a7a304a8c4 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] [instance: b756c8c1-b4b0-4d12-97f6-6c229a956b28] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:00.029661 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b5a65091-1511-4263-8fd2-56a7a304a8c4 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:00.030139 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b5a65091-1511-4263-8fd2-56a7a304a8c4 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:00.030571 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b5a65091-1511-4263-8fd2-56a7a304a8c4 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:00.031252 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b5a65091-1511-4263-8fd2-56a7a304a8c4 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:00.031736 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b5a65091-1511-4263-8fd2-56a7a304a8c4 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:00.032162 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b5a65091-1511-4263-8fd2-56a7a304a8c4 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:00.096179 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b5a65091-1511-4263-8fd2-56a7a304a8c4 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e146e6da0294fa78e07d8c1e971af3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c78ed6f8b354b1b9b07151736df1386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:00.104073 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b5a65091-1511-4263-8fd2-56a7a304a8c4 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] 10.222.0.30 "GET /compute/v2.1/servers/b756c8c1-b4b0-4d12-97f6-6c229a956b28" status: 200 len: 1210 microversion: 2.1 time: 0.085202 Aug 09 07:04:00.104636 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 131/259] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:00 2022] GET /compute/v2.1/servers/b756c8c1-b4b0-4d12-97f6-6c229a956b28 => generated 1210 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:00.690977 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-4a2de2c8-b453-4b5f-8214-2bb205b68e0a tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:00.691590 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-4a2de2c8-b453-4b5f-8214-2bb205b68e0a tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] [instance: 7240387f-c724-4ecb-9c26-d58666857ddf] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:00.698310 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4a2de2c8-b453-4b5f-8214-2bb205b68e0a tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:00.698788 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4a2de2c8-b453-4b5f-8214-2bb205b68e0a tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:00.699222 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4a2de2c8-b453-4b5f-8214-2bb205b68e0a tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:00.699944 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4a2de2c8-b453-4b5f-8214-2bb205b68e0a tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:00.700401 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4a2de2c8-b453-4b5f-8214-2bb205b68e0a tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:00.700829 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4a2de2c8-b453-4b5f-8214-2bb205b68e0a tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:00.828827 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-4a2de2c8-b453-4b5f-8214-2bb205b68e0a tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6b55d7cb1840a5ad93369589a36596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814c528dd56c4e61ae5cba5733bf2f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:00.836918 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-4a2de2c8-b453-4b5f-8214-2bb205b68e0a tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] 10.222.0.30 "GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf" status: 200 len: 1503 microversion: 2.1 time: 0.149786 Aug 09 07:04:00.837570 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 129/260] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:00 2022] GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:00.871746 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-1b581ee8-b34a-4a47-b26a-90c69835375e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:00.872353 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-1b581ee8-b34a-4a47-b26a-90c69835375e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:00.878739 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1b581ee8-b34a-4a47-b26a-90c69835375e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:00.879476 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1b581ee8-b34a-4a47-b26a-90c69835375e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:00.879928 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1b581ee8-b34a-4a47-b26a-90c69835375e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:00.880606 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1b581ee8-b34a-4a47-b26a-90c69835375e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:00.881058 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1b581ee8-b34a-4a47-b26a-90c69835375e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:00.881475 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1b581ee8-b34a-4a47-b26a-90c69835375e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:00.916539 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-646eff3a-e456-4378-878c-a8a2098d12eb tempest-VolumesGetTestJSON-927651953 tempest-VolumesGetTestJSON-927651953-project] Calling method '.version_select at 0x7f20ddd3ad30>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:00.964223 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-646eff3a-e456-4378-878c-a8a2098d12eb tempest-VolumesGetTestJSON-927651953 tempest-VolumesGetTestJSON-927651953-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/bf436520-1832-41dc-b754-8d27d4b44434" status: 200 len: 353 microversion: 2.1 time: 0.051612 Aug 09 07:04:00.964936 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 130/261] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Aug 9 07:04:00 2022] GET /compute/v2.1/os-volumes/bf436520-1832-41dc-b754-8d27d4b44434 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 07:04:01.009766 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-1b581ee8-b34a-4a47-b26a-90c69835375e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:01.017242 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-1b581ee8-b34a-4a47-b26a-90c69835375e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 200 len: 1521 microversion: 2.1 time: 0.150080 Aug 09 07:04:01.017810 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 132/262] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:00 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:01.125339 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-9bfc2b0d-abe2-474e-9ba4-888b608823a9 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:01.125951 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-9bfc2b0d-abe2-474e-9ba4-888b608823a9 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] [instance: b756c8c1-b4b0-4d12-97f6-6c229a956b28] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:01.132182 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9bfc2b0d-abe2-474e-9ba4-888b608823a9 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:01.133275 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9bfc2b0d-abe2-474e-9ba4-888b608823a9 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:01.133740 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9bfc2b0d-abe2-474e-9ba4-888b608823a9 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:01.134469 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9bfc2b0d-abe2-474e-9ba4-888b608823a9 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:01.134922 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9bfc2b0d-abe2-474e-9ba4-888b608823a9 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:01.135343 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9bfc2b0d-abe2-474e-9ba4-888b608823a9 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:01.198589 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-9bfc2b0d-abe2-474e-9ba4-888b608823a9 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e146e6da0294fa78e07d8c1e971af3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c78ed6f8b354b1b9b07151736df1386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:01.205848 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-9bfc2b0d-abe2-474e-9ba4-888b608823a9 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] 10.222.0.30 "GET /compute/v2.1/servers/b756c8c1-b4b0-4d12-97f6-6c229a956b28" status: 200 len: 1210 microversion: 2.1 time: 0.084312 Aug 09 07:04:01.206413 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 131/263] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:01 2022] GET /compute/v2.1/servers/b756c8c1-b4b0-4d12-97f6-6c229a956b28 => generated 1210 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:01.859802 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-ede103c1-e9d9-4ca8-8693-79ba4c2718ee tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:01.859802 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-ede103c1-e9d9-4ca8-8693-79ba4c2718ee tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] [instance: 7240387f-c724-4ecb-9c26-d58666857ddf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:01.865223 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ede103c1-e9d9-4ca8-8693-79ba4c2718ee tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:01.865702 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ede103c1-e9d9-4ca8-8693-79ba4c2718ee tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:01.866133 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ede103c1-e9d9-4ca8-8693-79ba4c2718ee tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:01.866823 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ede103c1-e9d9-4ca8-8693-79ba4c2718ee tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:01.867431 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ede103c1-e9d9-4ca8-8693-79ba4c2718ee tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:01.867883 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ede103c1-e9d9-4ca8-8693-79ba4c2718ee tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:01.978904 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-1b2ecbb1-5cdd-4fa9-a021-00fb94ff6709 tempest-VolumesGetTestJSON-927651953 tempest-VolumesGetTestJSON-927651953-project] Calling method '.version_select at 0x7f20ddd3a1f0>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:01.996117 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ede103c1-e9d9-4ca8-8693-79ba4c2718ee tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6b55d7cb1840a5ad93369589a36596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814c528dd56c4e61ae5cba5733bf2f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:02.003433 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-ede103c1-e9d9-4ca8-8693-79ba4c2718ee tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] 10.222.0.30 "GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf" status: 200 len: 1503 microversion: 2.1 time: 0.148974 Aug 09 07:04:02.004096 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 133/264] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:01 2022] GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf => generated 1503 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:02.025536 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-1b2ecbb1-5cdd-4fa9-a021-00fb94ff6709 tempest-VolumesGetTestJSON-927651953 tempest-VolumesGetTestJSON-927651953-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/bf436520-1832-41dc-b754-8d27d4b44434" status: 200 len: 353 microversion: 2.1 time: 0.051431 Aug 09 07:04:02.026103 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 132/265] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Aug 9 07:04:01 2022] GET /compute/v2.1/os-volumes/bf436520-1832-41dc-b754-8d27d4b44434 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 07:04:02.037817 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-ac87d1a8-4dc5-4749-9c47-46e29c077ff0 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:02.038444 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-ac87d1a8-4dc5-4749-9c47-46e29c077ff0 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:02.045176 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ac87d1a8-4dc5-4749-9c47-46e29c077ff0 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:02.045721 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ac87d1a8-4dc5-4749-9c47-46e29c077ff0 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:02.046277 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ac87d1a8-4dc5-4749-9c47-46e29c077ff0 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:02.047098 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ac87d1a8-4dc5-4749-9c47-46e29c077ff0 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:02.047559 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ac87d1a8-4dc5-4749-9c47-46e29c077ff0 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:02.048013 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ac87d1a8-4dc5-4749-9c47-46e29c077ff0 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:02.172284 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ac87d1a8-4dc5-4749-9c47-46e29c077ff0 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:02.180148 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-ac87d1a8-4dc5-4749-9c47-46e29c077ff0 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 200 len: 1521 microversion: 2.1 time: 0.145798 Aug 09 07:04:02.180755 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 134/266] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:02 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:02.226091 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-36c11aed-5d09-4dcd-b5fc-f103dbed25cd tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:02.226952 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-36c11aed-5d09-4dcd-b5fc-f103dbed25cd tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] [instance: b756c8c1-b4b0-4d12-97f6-6c229a956b28] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:02.232788 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-36c11aed-5d09-4dcd-b5fc-f103dbed25cd tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:02.233265 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-36c11aed-5d09-4dcd-b5fc-f103dbed25cd tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:02.233691 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-36c11aed-5d09-4dcd-b5fc-f103dbed25cd tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:02.234362 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-36c11aed-5d09-4dcd-b5fc-f103dbed25cd tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:02.234803 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-36c11aed-5d09-4dcd-b5fc-f103dbed25cd tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:02.235215 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-36c11aed-5d09-4dcd-b5fc-f103dbed25cd tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:02.298524 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-36c11aed-5d09-4dcd-b5fc-f103dbed25cd tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e146e6da0294fa78e07d8c1e971af3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c78ed6f8b354b1b9b07151736df1386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:02.306240 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-36c11aed-5d09-4dcd-b5fc-f103dbed25cd tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] 10.222.0.30 "GET /compute/v2.1/servers/b756c8c1-b4b0-4d12-97f6-6c229a956b28" status: 200 len: 1210 microversion: 2.1 time: 0.083893 Aug 09 07:04:02.306795 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 133/267] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:02 2022] GET /compute/v2.1/servers/b756c8c1-b4b0-4d12-97f6-6c229a956b28 => generated 1210 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:03.025352 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-70531bb4-e0c0-45a6-8b1a-214f3a873513 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:03.025963 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-70531bb4-e0c0-45a6-8b1a-214f3a873513 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] [instance: 7240387f-c724-4ecb-9c26-d58666857ddf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:03.032337 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-70531bb4-e0c0-45a6-8b1a-214f3a873513 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:03.032822 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-70531bb4-e0c0-45a6-8b1a-214f3a873513 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:03.033260 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-70531bb4-e0c0-45a6-8b1a-214f3a873513 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:03.033948 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-70531bb4-e0c0-45a6-8b1a-214f3a873513 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:03.034401 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-70531bb4-e0c0-45a6-8b1a-214f3a873513 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:03.034827 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-70531bb4-e0c0-45a6-8b1a-214f3a873513 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:03.037975 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-0ea572ad-ead8-4e81-b7b0-70109ca4a8ad tempest-VolumesGetTestJSON-927651953 tempest-VolumesGetTestJSON-927651953-project] Calling method '.version_select at 0x7f20ddd5d940>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:03.085258 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-0ea572ad-ead8-4e81-b7b0-70109ca4a8ad tempest-VolumesGetTestJSON-927651953 tempest-VolumesGetTestJSON-927651953-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/bf436520-1832-41dc-b754-8d27d4b44434" status: 200 len: 353 microversion: 2.1 time: 0.050995 Aug 09 07:04:03.085908 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 134/268] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Aug 9 07:04:03 2022] GET /compute/v2.1/os-volumes/bf436520-1832-41dc-b754-8d27d4b44434 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 07:04:03.163360 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-70531bb4-e0c0-45a6-8b1a-214f3a873513 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6b55d7cb1840a5ad93369589a36596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814c528dd56c4e61ae5cba5733bf2f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:03.171807 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-70531bb4-e0c0-45a6-8b1a-214f3a873513 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] 10.222.0.30 "GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf" status: 200 len: 1503 microversion: 2.1 time: 0.150305 Aug 09 07:04:03.172367 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 135/269] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:03 2022] GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:03.200829 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-4ddd4896-24b9-4168-878a-5a16c088d3c6 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:03.201437 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-4ddd4896-24b9-4168-878a-5a16c088d3c6 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:03.207296 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4ddd4896-24b9-4168-878a-5a16c088d3c6 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:03.207816 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4ddd4896-24b9-4168-878a-5a16c088d3c6 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:03.208252 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4ddd4896-24b9-4168-878a-5a16c088d3c6 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:03.208934 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4ddd4896-24b9-4168-878a-5a16c088d3c6 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:03.209385 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4ddd4896-24b9-4168-878a-5a16c088d3c6 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:03.209807 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4ddd4896-24b9-4168-878a-5a16c088d3c6 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:03.326511 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-50e2d8d6-ac94-4b2b-b21a-03f653b87ddd tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:03.327115 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-50e2d8d6-ac94-4b2b-b21a-03f653b87ddd tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] [instance: b756c8c1-b4b0-4d12-97f6-6c229a956b28] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:03.333132 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-50e2d8d6-ac94-4b2b-b21a-03f653b87ddd tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:03.333615 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-50e2d8d6-ac94-4b2b-b21a-03f653b87ddd tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:03.334045 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-50e2d8d6-ac94-4b2b-b21a-03f653b87ddd tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:03.334521 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-4ddd4896-24b9-4168-878a-5a16c088d3c6 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:03.334731 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-50e2d8d6-ac94-4b2b-b21a-03f653b87ddd tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:03.335180 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-50e2d8d6-ac94-4b2b-b21a-03f653b87ddd tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:03.336131 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-50e2d8d6-ac94-4b2b-b21a-03f653b87ddd tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:03.342797 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-4ddd4896-24b9-4168-878a-5a16c088d3c6 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 200 len: 1521 microversion: 2.1 time: 0.145723 Aug 09 07:04:03.343371 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 135/270] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:03 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:03.400206 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-50e2d8d6-ac94-4b2b-b21a-03f653b87ddd tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e146e6da0294fa78e07d8c1e971af3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c78ed6f8b354b1b9b07151736df1386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:03.407488 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-50e2d8d6-ac94-4b2b-b21a-03f653b87ddd tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] 10.222.0.30 "GET /compute/v2.1/servers/b756c8c1-b4b0-4d12-97f6-6c229a956b28" status: 200 len: 1210 microversion: 2.1 time: 0.084836 Aug 09 07:04:03.408089 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 136/271] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:03 2022] GET /compute/v2.1/servers/b756c8c1-b4b0-4d12-97f6-6c229a956b28 => generated 1210 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:04:04.098272 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-bdabf7ab-06f9-41b9-a0db-1c8a33f058a7 tempest-VolumesGetTestJSON-927651953 tempest-VolumesGetTestJSON-927651953-project] Calling method '.version_select at 0x7f20ddd5d160>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:04.144769 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-bdabf7ab-06f9-41b9-a0db-1c8a33f058a7 tempest-VolumesGetTestJSON-927651953 tempest-VolumesGetTestJSON-927651953-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/bf436520-1832-41dc-b754-8d27d4b44434" status: 200 len: 354 microversion: 2.1 time: 0.050220 Aug 09 07:04:04.145329 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 136/272] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Aug 9 07:04:04 2022] GET /compute/v2.1/os-volumes/bf436520-1832-41dc-b754-8d27d4b44434 => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:04:04.158074 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6e2aa09e-d88a-45cd-988e-14247c0ce5a6 tempest-VolumesGetTestJSON-927651953 tempest-VolumesGetTestJSON-927651953-project] Calling method '.version_select at 0x7f20dd5600d0>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:04.197635 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-a397d5fb-3d2b-47fb-a185-3993807eda10 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:04.198247 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-a397d5fb-3d2b-47fb-a185-3993807eda10 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] [instance: 7240387f-c724-4ecb-9c26-d58666857ddf] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:04.204063 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a397d5fb-3d2b-47fb-a185-3993807eda10 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:04.204534 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a397d5fb-3d2b-47fb-a185-3993807eda10 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:04.204961 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a397d5fb-3d2b-47fb-a185-3993807eda10 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:04.205640 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a397d5fb-3d2b-47fb-a185-3993807eda10 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:04.206080 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a397d5fb-3d2b-47fb-a185-3993807eda10 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:04.206563 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a397d5fb-3d2b-47fb-a185-3993807eda10 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:04.208741 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-6e2aa09e-d88a-45cd-988e-14247c0ce5a6 tempest-VolumesGetTestJSON-927651953 tempest-VolumesGetTestJSON-927651953-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/bf436520-1832-41dc-b754-8d27d4b44434" status: 200 len: 354 microversion: 2.1 time: 0.054349 Aug 09 07:04:04.209401 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 137/273] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Aug 9 07:04:04 2022] GET /compute/v2.1/os-volumes/bf436520-1832-41dc-b754-8d27d4b44434 => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:04:04.228735 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-db5609bf-d0aa-48fd-aa75-52a09b7fff02 tempest-VolumesGetTestJSON-927651953 tempest-VolumesGetTestJSON-927651953-project] Calling method '.version_select at 0x7f20dd54c700>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:04.318500 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-db5609bf-d0aa-48fd-aa75-52a09b7fff02 tempest-VolumesGetTestJSON-927651953 tempest-VolumesGetTestJSON-927651953-project] 10.222.0.30 "DELETE /compute/v2.1/os-volumes/bf436520-1832-41dc-b754-8d27d4b44434" status: 202 len: 0 microversion: 2.1 time: 0.094357 Aug 09 07:04:04.319073 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 138/274] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Aug 9 07:04:04 2022] DELETE /compute/v2.1/os-volumes/bf436520-1832-41dc-b754-8d27d4b44434 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 07:04:04.327906 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-1237c516-5b25-4c4d-8bfb-338fdcd96e0a tempest-VolumesGetTestJSON-927651953 tempest-VolumesGetTestJSON-927651953-project] Calling method '.version_select at 0x7f20dd4f8310>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:04.375662 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-a397d5fb-3d2b-47fb-a185-3993807eda10 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6b55d7cb1840a5ad93369589a36596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814c528dd56c4e61ae5cba5733bf2f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:04.384179 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-a397d5fb-3d2b-47fb-a185-3993807eda10 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] 10.222.0.30 "GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf" status: 200 len: 1503 microversion: 2.1 time: 0.190533 Aug 09 07:04:04.384755 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 137/275] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:04 2022] GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf => generated 1503 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:04.387355 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-1237c516-5b25-4c4d-8bfb-338fdcd96e0a tempest-VolumesGetTestJSON-927651953 tempest-VolumesGetTestJSON-927651953-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/bf436520-1832-41dc-b754-8d27d4b44434" status: 200 len: 353 microversion: 2.1 time: 0.063468 Aug 09 07:04:04.387963 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 139/276] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Aug 9 07:04:04 2022] GET /compute/v2.1/os-volumes/bf436520-1832-41dc-b754-8d27d4b44434 => generated 353 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:04:04.390217 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-73f445b5-7821-42a7-af49-7a1817adfc10 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:04.390821 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-73f445b5-7821-42a7-af49-7a1817adfc10 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:04.397393 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-73f445b5-7821-42a7-af49-7a1817adfc10 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:04.398164 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-73f445b5-7821-42a7-af49-7a1817adfc10 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:04.399120 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-73f445b5-7821-42a7-af49-7a1817adfc10 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:04.399849 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-73f445b5-7821-42a7-af49-7a1817adfc10 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:04.400306 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-73f445b5-7821-42a7-af49-7a1817adfc10 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:04.400733 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-73f445b5-7821-42a7-af49-7a1817adfc10 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:04.428441 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-dc71b584-3b60-450d-a4a0-84774c9a2b8a tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:04.429142 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-dc71b584-3b60-450d-a4a0-84774c9a2b8a tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] [instance: b756c8c1-b4b0-4d12-97f6-6c229a956b28] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:04.445717 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dc71b584-3b60-450d-a4a0-84774c9a2b8a tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:04.446435 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dc71b584-3b60-450d-a4a0-84774c9a2b8a tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:04.447111 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dc71b584-3b60-450d-a4a0-84774c9a2b8a tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:04.447933 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dc71b584-3b60-450d-a4a0-84774c9a2b8a tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:04.448462 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dc71b584-3b60-450d-a4a0-84774c9a2b8a tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:04.448957 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dc71b584-3b60-450d-a4a0-84774c9a2b8a tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:04.528077 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-dc71b584-3b60-450d-a4a0-84774c9a2b8a tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e146e6da0294fa78e07d8c1e971af3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c78ed6f8b354b1b9b07151736df1386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:04.536263 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-dc71b584-3b60-450d-a4a0-84774c9a2b8a tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] 10.222.0.30 "GET /compute/v2.1/servers/b756c8c1-b4b0-4d12-97f6-6c229a956b28" status: 200 len: 1274 microversion: 2.1 time: 0.111672 Aug 09 07:04:04.536858 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 140/277] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:04 2022] GET /compute/v2.1/servers/b756c8c1-b4b0-4d12-97f6-6c229a956b28 => generated 1274 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:04:04.571043 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-73f445b5-7821-42a7-af49-7a1817adfc10 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:04.579814 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-73f445b5-7821-42a7-af49-7a1817adfc10 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 200 len: 1521 microversion: 2.1 time: 0.194011 Aug 09 07:04:04.580391 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 138/278] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:04 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:05.286842 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-70caa044-d070-43db-8429-2ad6e672d4c0 req-f173f338-50bc-4ba0-b020-39fe45337e6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7240387f-c724-4ecb-9c26-d58666857ddf", "name": "network-vif-deleted", "tag": "be1a1b6c-36b3-4e80-8755-5e36c38bee83"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:04:05.298569 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-70caa044-d070-43db-8429-2ad6e672d4c0 req-f173f338-50bc-4ba0-b020-39fe45337e6c service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:05.299123 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-70caa044-d070-43db-8429-2ad6e672d4c0 req-f173f338-50bc-4ba0-b020-39fe45337e6c service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:05.299588 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-70caa044-d070-43db-8429-2ad6e672d4c0 req-f173f338-50bc-4ba0-b020-39fe45337e6c service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:05.303679 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:04:05.316274 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-70caa044-d070-43db-8429-2ad6e672d4c0 req-f173f338-50bc-4ba0-b020-39fe45337e6c service nova] Creating event network-vif-deleted:be1a1b6c-36b3-4e80-8755-5e36c38bee83 for instance 7240387f-c724-4ecb-9c26-d58666857ddf on hv-cinder-85251 Aug 09 07:04:05.322880 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-70caa044-d070-43db-8429-2ad6e672d4c0 req-f173f338-50bc-4ba0-b020-39fe45337e6c service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040403 Aug 09 07:04:05.324129 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 141/279] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:04:05.402334 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-4e810333-2226-40bc-97bc-5d132aab7471 tempest-VolumesGetTestJSON-927651953 tempest-VolumesGetTestJSON-927651953-project] Calling method '.version_select at 0x7f20ddd61e50>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:05.410200 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-eee61fe3-5fec-4ad6-956f-e251735b38df tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:05.410997 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-eee61fe3-5fec-4ad6-956f-e251735b38df tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] [instance: 7240387f-c724-4ecb-9c26-d58666857ddf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:05.419059 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-eee61fe3-5fec-4ad6-956f-e251735b38df tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:05.419549 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-eee61fe3-5fec-4ad6-956f-e251735b38df tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:05.420209 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-eee61fe3-5fec-4ad6-956f-e251735b38df tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:05.421215 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-eee61fe3-5fec-4ad6-956f-e251735b38df tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:05.421959 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-eee61fe3-5fec-4ad6-956f-e251735b38df tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:05.422534 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-eee61fe3-5fec-4ad6-956f-e251735b38df tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:05.455963 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.wsgi [None req-4e810333-2226-40bc-97bc-5d132aab7471 tempest-VolumesGetTestJSON-927651953 tempest-VolumesGetTestJSON-927651953-project] HTTP exception thrown: Volume bf436520-1832-41dc-b754-8d27d4b44434 could not be found. Aug 09 07:04:05.458867 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-4e810333-2226-40bc-97bc-5d132aab7471 tempest-VolumesGetTestJSON-927651953 tempest-VolumesGetTestJSON-927651953-project] Request method failure captured: Aug 09 07:04:05.458867 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: request: GET /compute/v2.1/os-volumes/bf436520-1832-41dc-b754-8d27d4b44434 HTTP/1.1 Aug 09 07:04:05.458867 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Accept: application/json Aug 09 07:04:05.458867 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Accept-Encoding: identity Aug 09 07:04:05.458867 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Connection: close Aug 09 07:04:05.458867 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Content-Length: 0 Aug 09 07:04:05.458867 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Content-Type: application/json Aug 09 07:04:05.458867 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Host: 10.222.0.30 Aug 09 07:04:05.458867 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Openstack-System-Scope: None Aug 09 07:04:05.458867 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: User-Agent: python-urllib3/1.26.11 Aug 09 07:04:05.458867 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Auth-Token: gAAAAABi8gbfbrtU6MJuvsf9puNHR-Ucsg9BVaMOwdzPmSKtyGsMzd7jRzOCo9vosTyafCYXtCSCxIV2KCpX24ocwBn3DXNQ39kntDub53V1R6mHXDKf6vndJzVNgeachHbxSY0xXIsnAE5nN8pr7_ga-pyhwWyVvW4ia9adzc8Q1bDxL9IOtoQ Aug 09 07:04:05.458867 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Domain-Id: None Aug 09 07:04:05.458867 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Domain-Name: None Aug 09 07:04:05.458867 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Identity-Status: Confirmed Aug 09 07:04:05.458867 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Is-Admin-Project: True Aug 09 07:04:05.458867 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Domain-Id: default Aug 09 07:04:05.458867 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Domain-Name: Default Aug 09 07:04:05.458867 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Id: 435ce18280514d49beb55d8dd51d5876 Aug 09 07:04:05.458867 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Name: tempest-VolumesGetTestJSON-927651953 Aug 09 07:04:05.458867 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Role: reader,member Aug 09 07:04:05.458867 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Roles: reader,member Aug 09 07:04:05.460397 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/435ce18280514d49beb55d8dd51d5876"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_435ce18280514d49beb55d8dd51d5876"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/435ce18280514d49beb55d8dd51d5876"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/435ce18280514d49beb55d8dd51d5876"}]}] Aug 09 07:04:05.460397 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant: tempest-VolumesGetTestJSON-927651953 Aug 09 07:04:05.460397 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant-Id: 435ce18280514d49beb55d8dd51d5876 Aug 09 07:04:05.460397 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant-Name: tempest-VolumesGetTestJSON-927651953 Aug 09 07:04:05.460397 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User: tempest-VolumesGetTestJSON-927651953-project Aug 09 07:04:05.460397 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Domain-Id: default Aug 09 07:04:05.460397 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Domain-Name: Default Aug 09 07:04:05.460397 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Id: d44100ba230f478a9d3b1fc58431ed58 Aug 09 07:04:05.460397 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Name: tempest-VolumesGetTestJSON-927651953-project Aug 09 07:04:05.460397 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: method: Aug 09 07:04:05.460397 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: exception: Volume bf436520-1832-41dc-b754-8d27d4b44434 could not be found. Aug 09 07:04:05.460397 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: action_args: {'id': 'bf436520-1832-41dc-b754-8d27d4b44434'} Aug 09 07:04:05.460397 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 07:04:05.461692 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:04:05.461692 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 07:04:05.461692 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 07:04:05.461692 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 07:04:05.461692 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 07:04:05.461692 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 07:04:05.461692 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 07:04:05.461692 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 07:04:05.461692 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 07:04:05.461692 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 07:04:05.461692 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 07:04:05.461692 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 07:04:05.461692 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 07:04:05.461692 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 07:04:05.461692 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 07:04:05.461692 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bf436520-1832-41dc-b754-8d27d4b44434 could not be found. (HTTP 404) (Request-ID: req-5cfd01a3-ee30-4cd5-9cd1-554b6223f0fe) Aug 09 07:04:05.461692 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:04:05.461692 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:04:05.461692 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:04:05.462769 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:04:05.462769 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 09 07:04:05.462769 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 09 07:04:05.462769 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 09 07:04:05.462769 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 09 07:04:05.462769 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 09 07:04:05.462769 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 09 07:04:05.462769 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 09 07:04:05.462769 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 09 07:04:05.462769 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 09 07:04:05.462769 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 09 07:04:05.462769 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 09 07:04:05.462769 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 09 07:04:05.462769 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 09 07:04:05.462769 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 09 07:04:05.462769 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 09 07:04:05.462769 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 09 07:04:05.462769 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 09 07:04:05.462769 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 09 07:04:05.463868 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 09 07:04:05.463868 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 09 07:04:05.463868 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 09 07:04:05.463868 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 09 07:04:05.463868 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bf436520-1832-41dc-b754-8d27d4b44434 could not be found. Aug 09 07:04:05.463868 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:04:05.463868 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:04:05.463868 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:04:05.463868 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:04:05.463868 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:04:05.463868 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:04:05.463868 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 07:04:05.463868 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 07:04:05.463868 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 09 07:04:05.463868 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 09 07:04:05.463868 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 07:04:05.463868 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 07:04:05.463868 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 09 07:04:05.463868 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 07:04:05.464967 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bf436520-1832-41dc-b754-8d27d4b44434 could not be found. Aug 09 07:04:05.464967 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:04:05.464967 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:04:05.464967 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:04:05.464967 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:04:05.464967 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:04:05.464967 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:04:05.464967 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 07:04:05.464967 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 07:04:05.464967 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bf436520-1832-41dc-b754-8d27d4b44434 could not be found. Aug 09 07:04:05.464967 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:04:05.468066 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-4e810333-2226-40bc-97bc-5d132aab7471 tempest-VolumesGetTestJSON-927651953 tempest-VolumesGetTestJSON-927651953-project] Returning 404 to user: Volume bf436520-1832-41dc-b754-8d27d4b44434 could not be found. {{(pid=117858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 07:04:05.469580 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-4e810333-2226-40bc-97bc-5d132aab7471 tempest-VolumesGetTestJSON-927651953 tempest-VolumesGetTestJSON-927651953-project] 10.222.0.30 "GET /compute/v2.1/os-volumes/bf436520-1832-41dc-b754-8d27d4b44434" status: 404 len: 109 microversion: 2.1 time: 0.071937 Aug 09 07:04:05.470225 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 139/280] 10.222.0.30 () {58 vars in 1245 bytes} [Tue Aug 9 07:04:05 2022] GET /compute/v2.1/os-volumes/bf436520-1832-41dc-b754-8d27d4b44434 => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 07:04:05.505404 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-eee61fe3-5fec-4ad6-956f-e251735b38df tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6b55d7cb1840a5ad93369589a36596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814c528dd56c4e61ae5cba5733bf2f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:05.514979 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-eee61fe3-5fec-4ad6-956f-e251735b38df tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] 10.222.0.30 "GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf" status: 200 len: 1299 microversion: 2.1 time: 0.111582 Aug 09 07:04:05.515997 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 142/281] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:05 2022] GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf => generated 1299 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:05.558995 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-30c01a60-de8a-4ad8-b603-eec6f74da7dc tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:05.559622 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-30c01a60-de8a-4ad8-b603-eec6f74da7dc tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] [instance: b756c8c1-b4b0-4d12-97f6-6c229a956b28] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:05.566264 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-30c01a60-de8a-4ad8-b603-eec6f74da7dc tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:05.566746 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-30c01a60-de8a-4ad8-b603-eec6f74da7dc tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:05.567281 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-30c01a60-de8a-4ad8-b603-eec6f74da7dc tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:05.568034 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-30c01a60-de8a-4ad8-b603-eec6f74da7dc tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:05.568378 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-30c01a60-de8a-4ad8-b603-eec6f74da7dc tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:05.568805 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-30c01a60-de8a-4ad8-b603-eec6f74da7dc tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:05.615264 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4330088d-ce4c-4ebc-841b-8d23b5d9da4a tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:05.616120 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4330088d-ce4c-4ebc-841b-8d23b5d9da4a tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:05.629058 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4330088d-ce4c-4ebc-841b-8d23b5d9da4a tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:05.629809 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4330088d-ce4c-4ebc-841b-8d23b5d9da4a tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:05.630250 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4330088d-ce4c-4ebc-841b-8d23b5d9da4a tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:05.630964 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4330088d-ce4c-4ebc-841b-8d23b5d9da4a tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:05.631416 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4330088d-ce4c-4ebc-841b-8d23b5d9da4a tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:05.631869 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4330088d-ce4c-4ebc-841b-8d23b5d9da4a tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:05.669461 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-30c01a60-de8a-4ad8-b603-eec6f74da7dc tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e146e6da0294fa78e07d8c1e971af3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c78ed6f8b354b1b9b07151736df1386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:05.680741 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-30c01a60-de8a-4ad8-b603-eec6f74da7dc tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] 10.222.0.30 "GET /compute/v2.1/servers/b756c8c1-b4b0-4d12-97f6-6c229a956b28" status: 200 len: 1272 microversion: 2.1 time: 0.125773 Aug 09 07:04:05.681710 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 140/282] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:05 2022] GET /compute/v2.1/servers/b756c8c1-b4b0-4d12-97f6-6c229a956b28 => generated 1272 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:05.826812 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4330088d-ce4c-4ebc-841b-8d23b5d9da4a tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:05.835307 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4330088d-ce4c-4ebc-841b-8d23b5d9da4a tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 200 len: 1521 microversion: 2.1 time: 0.234295 Aug 09 07:04:05.836291 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 143/283] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:05 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:04:06.536460 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-a84babcd-1be0-4ed8-8003-18f435274707 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:06.537298 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-a84babcd-1be0-4ed8-8003-18f435274707 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] [instance: 7240387f-c724-4ecb-9c26-d58666857ddf] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:06.544334 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a84babcd-1be0-4ed8-8003-18f435274707 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:06.544825 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a84babcd-1be0-4ed8-8003-18f435274707 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:06.545233 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a84babcd-1be0-4ed8-8003-18f435274707 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:06.545911 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a84babcd-1be0-4ed8-8003-18f435274707 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:06.546360 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a84babcd-1be0-4ed8-8003-18f435274707 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:06.546771 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a84babcd-1be0-4ed8-8003-18f435274707 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:06.578705 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a84babcd-1be0-4ed8-8003-18f435274707 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:06.579262 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a84babcd-1be0-4ed8-8003-18f435274707 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:06.579857 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a84babcd-1be0-4ed8-8003-18f435274707 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:06.580307 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.objects.instance [None req-a84babcd-1be0-4ed8-8003-18f435274707 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lazy-loading 'fault' on Instance uuid 7240387f-c724-4ecb-9c26-d58666857ddf {{(pid=117858) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 07:04:06.628841 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-a84babcd-1be0-4ed8-8003-18f435274707 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6b55d7cb1840a5ad93369589a36596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814c528dd56c4e61ae5cba5733bf2f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:06.636836 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-a84babcd-1be0-4ed8-8003-18f435274707 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] 10.222.0.30 "GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf" status: 200 len: 1304 microversion: 2.1 time: 0.104120 Aug 09 07:04:06.637397 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 141/284] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:06 2022] GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf => generated 1304 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:04:06.701505 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-920ba7dd-5f78-4e94-95e3-2a479ff05048 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:06.702139 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-920ba7dd-5f78-4e94-95e3-2a479ff05048 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] [instance: b756c8c1-b4b0-4d12-97f6-6c229a956b28] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:06.709276 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-920ba7dd-5f78-4e94-95e3-2a479ff05048 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:06.709828 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-920ba7dd-5f78-4e94-95e3-2a479ff05048 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:06.710329 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-920ba7dd-5f78-4e94-95e3-2a479ff05048 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:06.711359 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-920ba7dd-5f78-4e94-95e3-2a479ff05048 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:06.712137 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-920ba7dd-5f78-4e94-95e3-2a479ff05048 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:06.712564 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-920ba7dd-5f78-4e94-95e3-2a479ff05048 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:06.853193 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-920ba7dd-5f78-4e94-95e3-2a479ff05048 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e146e6da0294fa78e07d8c1e971af3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c78ed6f8b354b1b9b07151736df1386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:06.859503 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-caa13c1a-4d2a-4b3a-9ff9-ad49d3aa8077 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:06.859503 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-caa13c1a-4d2a-4b3a-9ff9-ad49d3aa8077 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:06.862000 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-920ba7dd-5f78-4e94-95e3-2a479ff05048 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] 10.222.0.30 "GET /compute/v2.1/servers/b756c8c1-b4b0-4d12-97f6-6c229a956b28" status: 200 len: 1314 microversion: 2.1 time: 0.164201 Aug 09 07:04:06.864016 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-caa13c1a-4d2a-4b3a-9ff9-ad49d3aa8077 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:06.864503 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-caa13c1a-4d2a-4b3a-9ff9-ad49d3aa8077 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:06.864934 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-caa13c1a-4d2a-4b3a-9ff9-ad49d3aa8077 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:06.865626 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-caa13c1a-4d2a-4b3a-9ff9-ad49d3aa8077 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:06.866072 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-caa13c1a-4d2a-4b3a-9ff9-ad49d3aa8077 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:06.866490 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-caa13c1a-4d2a-4b3a-9ff9-ad49d3aa8077 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:06.870083 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 144/285] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:06 2022] GET /compute/v2.1/servers/b756c8c1-b4b0-4d12-97f6-6c229a956b28 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:06.996908 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-caa13c1a-4d2a-4b3a-9ff9-ad49d3aa8077 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:07.004661 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-caa13c1a-4d2a-4b3a-9ff9-ad49d3aa8077 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 200 len: 1521 microversion: 2.1 time: 0.151426 Aug 09 07:04:07.005224 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 142/286] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:06 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:04:07.657015 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-ae8b22b7-277f-4f24-aa7b-77a0da239dae tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:07.657666 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-ae8b22b7-277f-4f24-aa7b-77a0da239dae tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] [instance: 7240387f-c724-4ecb-9c26-d58666857ddf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:07.663715 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ae8b22b7-277f-4f24-aa7b-77a0da239dae tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:07.664206 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ae8b22b7-277f-4f24-aa7b-77a0da239dae tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:07.664640 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ae8b22b7-277f-4f24-aa7b-77a0da239dae tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:07.665334 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ae8b22b7-277f-4f24-aa7b-77a0da239dae tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:07.665795 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ae8b22b7-277f-4f24-aa7b-77a0da239dae tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:07.666221 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ae8b22b7-277f-4f24-aa7b-77a0da239dae tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:07.697895 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ae8b22b7-277f-4f24-aa7b-77a0da239dae tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:07.698495 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ae8b22b7-277f-4f24-aa7b-77a0da239dae tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:07.699004 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ae8b22b7-277f-4f24-aa7b-77a0da239dae tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:07.699428 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.objects.instance [None req-ae8b22b7-277f-4f24-aa7b-77a0da239dae tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lazy-loading 'fault' on Instance uuid 7240387f-c724-4ecb-9c26-d58666857ddf {{(pid=117859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 07:04:07.745623 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ae8b22b7-277f-4f24-aa7b-77a0da239dae tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6b55d7cb1840a5ad93369589a36596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814c528dd56c4e61ae5cba5733bf2f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:07.754434 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-ae8b22b7-277f-4f24-aa7b-77a0da239dae tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] 10.222.0.30 "GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf" status: 200 len: 1304 microversion: 2.1 time: 0.100945 Aug 09 07:04:07.755321 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 145/287] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:07 2022] GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:07.885605 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-fe9cafae-f005-4ad1-b0bd-ea262908d29a tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:07.886218 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-fe9cafae-f005-4ad1-b0bd-ea262908d29a tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] [instance: b756c8c1-b4b0-4d12-97f6-6c229a956b28] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:07.892010 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-fe9cafae-f005-4ad1-b0bd-ea262908d29a tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:07.892488 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-fe9cafae-f005-4ad1-b0bd-ea262908d29a tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:07.892914 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-fe9cafae-f005-4ad1-b0bd-ea262908d29a tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:07.893593 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-fe9cafae-f005-4ad1-b0bd-ea262908d29a tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:07.894036 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-fe9cafae-f005-4ad1-b0bd-ea262908d29a tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:07.894451 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-fe9cafae-f005-4ad1-b0bd-ea262908d29a tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:08.023722 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-fe9cafae-f005-4ad1-b0bd-ea262908d29a tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e146e6da0294fa78e07d8c1e971af3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c78ed6f8b354b1b9b07151736df1386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:08.025825 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-5f07c621-5060-44b9-acda-f8538b0117e9 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:08.026461 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-5f07c621-5060-44b9-acda-f8538b0117e9 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:08.031038 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-fe9cafae-f005-4ad1-b0bd-ea262908d29a tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] 10.222.0.30 "GET /compute/v2.1/servers/b756c8c1-b4b0-4d12-97f6-6c229a956b28" status: 200 len: 1314 microversion: 2.1 time: 0.151012 Aug 09 07:04:08.031619 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 143/288] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:07 2022] GET /compute/v2.1/servers/b756c8c1-b4b0-4d12-97f6-6c229a956b28 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:08.032786 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5f07c621-5060-44b9-acda-f8538b0117e9 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:08.033309 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5f07c621-5060-44b9-acda-f8538b0117e9 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:08.033751 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5f07c621-5060-44b9-acda-f8538b0117e9 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:08.034451 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5f07c621-5060-44b9-acda-f8538b0117e9 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:08.034909 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5f07c621-5060-44b9-acda-f8538b0117e9 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:08.035337 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5f07c621-5060-44b9-acda-f8538b0117e9 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:08.162801 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-5f07c621-5060-44b9-acda-f8538b0117e9 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:08.171070 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-5f07c621-5060-44b9-acda-f8538b0117e9 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 200 len: 1521 microversion: 2.1 time: 0.149375 Aug 09 07:04:08.171653 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 146/289] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:08 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:04:08.779433 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-1799e14f-67e2-4cd3-9cdc-062416ec9fc9 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:08.781251 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-1799e14f-67e2-4cd3-9cdc-062416ec9fc9 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] [instance: 7240387f-c724-4ecb-9c26-d58666857ddf] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:08.789481 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1799e14f-67e2-4cd3-9cdc-062416ec9fc9 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:08.790468 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1799e14f-67e2-4cd3-9cdc-062416ec9fc9 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:08.791115 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1799e14f-67e2-4cd3-9cdc-062416ec9fc9 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:08.792157 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1799e14f-67e2-4cd3-9cdc-062416ec9fc9 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:08.792823 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1799e14f-67e2-4cd3-9cdc-062416ec9fc9 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:08.793528 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1799e14f-67e2-4cd3-9cdc-062416ec9fc9 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:08.799884 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_cell1:SELECT=100 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:04:08.811111 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.wsgi [None req-1799e14f-67e2-4cd3-9cdc-062416ec9fc9 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] HTTP exception thrown: Instance 7240387f-c724-4ecb-9c26-d58666857ddf could not be found. Aug 09 07:04:08.813492 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-1799e14f-67e2-4cd3-9cdc-062416ec9fc9 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Request method failure captured: Aug 09 07:04:08.813492 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: request: GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf HTTP/1.1 Aug 09 07:04:08.813492 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Accept: application/json Aug 09 07:04:08.813492 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Accept-Encoding: identity Aug 09 07:04:08.813492 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Connection: close Aug 09 07:04:08.813492 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Content-Length: 0 Aug 09 07:04:08.813492 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Content-Type: application/json Aug 09 07:04:08.813492 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Host: 10.222.0.30 Aug 09 07:04:08.813492 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Openstack-System-Scope: None Aug 09 07:04:08.813492 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: User-Agent: python-urllib3/1.26.11 Aug 09 07:04:08.813492 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Auth-Token: gAAAAABi8gbA-VT_HofQdH2L2WrygQBSPDK3__NUyFlVyrGK7H7OLxcCtm4pAfiZxCe7amFxWnRgm3PZ_66-f6pQ6ox2-os-xZ-y4xylA79CBFNymBwQQ21Cf3t5FZCIoMJqPHmLw9vTVvRyjWndGFfs2wZd3XSXOJ1EfBV2Q-N2NglzShGi7Y0 Aug 09 07:04:08.813492 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Domain-Id: None Aug 09 07:04:08.813492 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Domain-Name: None Aug 09 07:04:08.813492 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Identity-Status: Confirmed Aug 09 07:04:08.813492 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Is-Admin-Project: True Aug 09 07:04:08.813492 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Domain-Id: default Aug 09 07:04:08.813492 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Domain-Name: Default Aug 09 07:04:08.813492 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Id: 814c528dd56c4e61ae5cba5733bf2f08 Aug 09 07:04:08.813492 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Name: tempest-VolumesActionsTest-1153304816 Aug 09 07:04:08.813492 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Role: reader,member Aug 09 07:04:08.813492 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Roles: reader,member Aug 09 07:04:08.814671 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/814c528dd56c4e61ae5cba5733bf2f08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_814c528dd56c4e61ae5cba5733bf2f08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/814c528dd56c4e61ae5cba5733bf2f08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/814c528dd56c4e61ae5cba5733bf2f08"}]}] Aug 09 07:04:08.814671 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant: tempest-VolumesActionsTest-1153304816 Aug 09 07:04:08.814671 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant-Id: 814c528dd56c4e61ae5cba5733bf2f08 Aug 09 07:04:08.814671 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant-Name: tempest-VolumesActionsTest-1153304816 Aug 09 07:04:08.814671 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User: tempest-VolumesActionsTest-1153304816-project Aug 09 07:04:08.814671 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Domain-Id: default Aug 09 07:04:08.814671 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Domain-Name: Default Aug 09 07:04:08.814671 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Id: 2a6b55d7cb1840a5ad93369589a36596 Aug 09 07:04:08.814671 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Name: tempest-VolumesActionsTest-1153304816-project Aug 09 07:04:08.814671 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: method: > Aug 09 07:04:08.814671 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: exception: Instance 7240387f-c724-4ecb-9c26-d58666857ddf could not be found. Aug 09 07:04:08.814671 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: action_args: {'id': '7240387f-c724-4ecb-9c26-d58666857ddf'} Aug 09 07:04:08.815416 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 07:04:08.815416 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:04:08.815416 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 07:04:08.815416 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 07:04:08.815416 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 07:04:08.815416 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 07:04:08.815416 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 07:04:08.815416 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 07:04:08.815416 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 07:04:08.815416 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 07:04:08.815416 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7240387f-c724-4ecb-9c26-d58666857ddf could not be found. Aug 09 07:04:08.815416 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:04:08.815416 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:04:08.815416 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:04:08.815416 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:04:08.815416 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:04:08.815416 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:04:08.815416 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 07:04:08.815416 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 07:04:08.815416 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 07:04:08.816615 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 07:04:08.816615 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 07:04:08.816615 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 07:04:08.816615 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 07:04:08.816615 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 07:04:08.816615 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 07:04:08.816615 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 07:04:08.816615 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7240387f-c724-4ecb-9c26-d58666857ddf could not be found. Aug 09 07:04:08.816615 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:04:08.816615 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:04:08.816615 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:04:08.816615 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:04:08.816615 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:04:08.816615 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:04:08.816615 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 07:04:08.816615 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 07:04:08.816615 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7240387f-c724-4ecb-9c26-d58666857ddf could not be found. Aug 09 07:04:08.816615 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:04:08.819053 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-1799e14f-67e2-4cd3-9cdc-062416ec9fc9 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Returning 404 to user: Instance 7240387f-c724-4ecb-9c26-d58666857ddf could not be found. {{(pid=117858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 07:04:08.820763 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-1799e14f-67e2-4cd3-9cdc-062416ec9fc9 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] 10.222.0.30 "GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf" status: 404 len: 111 microversion: 2.1 time: 0.047828 Aug 09 07:04:08.821321 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 144/290] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:08 2022] GET /compute/v2.1/servers/7240387f-c724-4ecb-9c26-d58666857ddf => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 07:04:08.953844 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-1c73a3bc-efbd-4bc2-ba33-deb56cc40d67 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1268280282", "imageRef": "5d2c35cc-2f3b-4a22-bd68-79c71882b6a2", "flavorRef": "452", "networks": [{"uuid": "b93714ab-dd44-4cef-b08e-bf9e4354d84a"}]}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:04:08.966154 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=2 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:04:08.967402 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=6 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:04:09.019874 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.network.neutron [None req-1c73a3bc-efbd-4bc2-ba33-deb56cc40d67 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] validate_networks() for [('b93714ab-dd44-4cef-b08e-bf9e4354d84a', None, None, None, None, None)] {{(pid=117859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 07:04:09.052105 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-9751df3d-b916-4e44-a22b-f43d6f1d88cf tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:09.053746 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-9751df3d-b916-4e44-a22b-f43d6f1d88cf tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] [instance: b756c8c1-b4b0-4d12-97f6-6c229a956b28] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:09.055799 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_cell0:SELECT=2 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:04:09.061283 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9751df3d-b916-4e44-a22b-f43d6f1d88cf tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:09.061776 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9751df3d-b916-4e44-a22b-f43d6f1d88cf tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:09.062219 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9751df3d-b916-4e44-a22b-f43d6f1d88cf tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:09.062918 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9751df3d-b916-4e44-a22b-f43d6f1d88cf tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:09.063552 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9751df3d-b916-4e44-a22b-f43d6f1d88cf tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:09.064010 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9751df3d-b916-4e44-a22b-f43d6f1d88cf tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:09.264867 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-9751df3d-b916-4e44-a22b-f43d6f1d88cf tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e146e6da0294fa78e07d8c1e971af3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c78ed6f8b354b1b9b07151736df1386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:09.272870 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-9751df3d-b916-4e44-a22b-f43d6f1d88cf tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] 10.222.0.30 "GET /compute/v2.1/servers/b756c8c1-b4b0-4d12-97f6-6c229a956b28" status: 200 len: 1314 microversion: 2.1 time: 0.224709 Aug 09 07:04:09.274053 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 145/291] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:09 2022] GET /compute/v2.1/servers/b756c8c1-b4b0-4d12-97f6-6c229a956b28 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:04:09.279326 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-c4d101de-2329-4050-b522-e5a9276736da tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:09.280536 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-c4d101de-2329-4050-b522-e5a9276736da tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:09.286982 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c4d101de-2329-4050-b522-e5a9276736da tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:09.287467 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c4d101de-2329-4050-b522-e5a9276736da tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:09.288207 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c4d101de-2329-4050-b522-e5a9276736da tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:09.288817 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c4d101de-2329-4050-b522-e5a9276736da tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:09.289500 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c4d101de-2329-4050-b522-e5a9276736da tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:09.290169 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c4d101de-2329-4050-b522-e5a9276736da tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:09.506522 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-c4d101de-2329-4050-b522-e5a9276736da tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:09.515236 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-c4d101de-2329-4050-b522-e5a9276736da tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 200 len: 1521 microversion: 2.1 time: 0.240016 Aug 09 07:04:09.516098 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 146/292] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:09 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:09.520507 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [req-02f4cec6-ff88-416f-97a5-29e913f7f575 req-4da1dbfb-8c1e-449d-8c86-373d46cc7e9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b756c8c1-b4b0-4d12-97f6-6c229a956b28", "tag": "1189049f-9e27-4536-8c98-b0ede4a6d15a"}]} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:04:09.530055 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-02f4cec6-ff88-416f-97a5-29e913f7f575 req-4da1dbfb-8c1e-449d-8c86-373d46cc7e9b service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:09.530656 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-02f4cec6-ff88-416f-97a5-29e913f7f575 req-4da1dbfb-8c1e-449d-8c86-373d46cc7e9b service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:09.531334 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-02f4cec6-ff88-416f-97a5-29e913f7f575 req-4da1dbfb-8c1e-449d-8c86-373d46cc7e9b service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:09.544479 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.compute.server_external_events [req-02f4cec6-ff88-416f-97a5-29e913f7f575 req-4da1dbfb-8c1e-449d-8c86-373d46cc7e9b service nova] Creating event network-changed:1189049f-9e27-4536-8c98-b0ede4a6d15a for instance b756c8c1-b4b0-4d12-97f6-6c229a956b28 on hv-cinder-85251 Aug 09 07:04:09.550086 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [req-02f4cec6-ff88-416f-97a5-29e913f7f575 req-4da1dbfb-8c1e-449d-8c86-373d46cc7e9b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032856 Aug 09 07:04:09.550784 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 147/293] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:04:09.551346 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-1c73a3bc-efbd-4bc2-ba33-deb56cc40d67 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Flavor limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 07:04:09.551802 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-1c73a3bc-efbd-4bc2-ba33-deb56cc40d67 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Image limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 07:04:09.552396 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-1c73a3bc-efbd-4bc2-ba33-deb56cc40d67 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Flavor pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 07:04:09.552827 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-1c73a3bc-efbd-4bc2-ba33-deb56cc40d67 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Image pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 07:04:09.553199 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-1c73a3bc-efbd-4bc2-ba33-deb56cc40d67 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 07:04:09.562826 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1c73a3bc-efbd-4bc2-ba33-deb56cc40d67 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:09.563302 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1c73a3bc-efbd-4bc2-ba33-deb56cc40d67 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:09.563772 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1c73a3bc-efbd-4bc2-ba33-deb56cc40d67 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:09.564497 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1c73a3bc-efbd-4bc2-ba33-deb56cc40d67 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:09.564948 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1c73a3bc-efbd-4bc2-ba33-deb56cc40d67 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:09.565368 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1c73a3bc-efbd-4bc2-ba33-deb56cc40d67 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:09.582539 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-1c73a3bc-efbd-4bc2-ba33-deb56cc40d67 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Getting quotas for project 814c528dd56c4e61ae5cba5733bf2f08. Resources: {'cores', 'instances', 'ram'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 07:04:09.586621 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-1c73a3bc-efbd-4bc2-ba33-deb56cc40d67 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Getting quotas for user 2a6b55d7cb1840a5ad93369589a36596 and project 814c528dd56c4e61ae5cba5733bf2f08. Resources: {'cores', 'instances', 'ram'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 07:04:09.597369 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-1c73a3bc-efbd-4bc2-ba33-deb56cc40d67 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Going to run 1 instances... {{(pid=117859) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 07:04:09.600157 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-1c73a3bc-efbd-4bc2-ba33-deb56cc40d67 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] [instance: a57723ea-6384-4eee-b52d-f5f86e476fb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5d2c35cc-2f3b-4a22-bd68-79c71882b6a2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 07:04:09.647028 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-1c73a3bc-efbd-4bc2-ba33-deb56cc40d67 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.698216 Aug 09 07:04:09.647977 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 147/294] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 9 07:04:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 07:04:09.659908 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-b8cdf7d8-d835-499d-9ebf-edc9dae3f411 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:09.661027 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-b8cdf7d8-d835-499d-9ebf-edc9dae3f411 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] [instance: a57723ea-6384-4eee-b52d-f5f86e476fb0] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:09.716068 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-b8cdf7d8-d835-499d-9ebf-edc9dae3f411 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6b55d7cb1840a5ad93369589a36596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814c528dd56c4e61ae5cba5733bf2f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:09.722863 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-b8cdf7d8-d835-499d-9ebf-edc9dae3f411 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] 10.222.0.30 "GET /compute/v2.1/servers/a57723ea-6384-4eee-b52d-f5f86e476fb0" status: 200 len: 1214 microversion: 2.1 time: 0.067873 Aug 09 07:04:09.723494 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 148/295] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:09 2022] GET /compute/v2.1/servers/a57723ea-6384-4eee-b52d-f5f86e476fb0 => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:04:10.295047 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-921555dc-933f-498f-887b-b4fd8cced020 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:10.295690 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-921555dc-933f-498f-887b-b4fd8cced020 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] [instance: b756c8c1-b4b0-4d12-97f6-6c229a956b28] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:10.302049 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-921555dc-933f-498f-887b-b4fd8cced020 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:10.302535 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-921555dc-933f-498f-887b-b4fd8cced020 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:10.303088 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-921555dc-933f-498f-887b-b4fd8cced020 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:10.303698 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-921555dc-933f-498f-887b-b4fd8cced020 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:10.304199 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-921555dc-933f-498f-887b-b4fd8cced020 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:10.304649 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-921555dc-933f-498f-887b-b4fd8cced020 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:10.462245 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-921555dc-933f-498f-887b-b4fd8cced020 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e146e6da0294fa78e07d8c1e971af3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c78ed6f8b354b1b9b07151736df1386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:10.470504 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-921555dc-933f-498f-887b-b4fd8cced020 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] 10.222.0.30 "GET /compute/v2.1/servers/b756c8c1-b4b0-4d12-97f6-6c229a956b28" status: 200 len: 1314 microversion: 2.1 time: 0.179841 Aug 09 07:04:10.471574 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 148/296] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:10 2022] GET /compute/v2.1/servers/b756c8c1-b4b0-4d12-97f6-6c229a956b28 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:10.537077 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-01ec905e-2eb1-46b0-9b7f-8adf1d5d3a25 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:10.538294 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-01ec905e-2eb1-46b0-9b7f-8adf1d5d3a25 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:10.544890 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-01ec905e-2eb1-46b0-9b7f-8adf1d5d3a25 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:10.545368 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-01ec905e-2eb1-46b0-9b7f-8adf1d5d3a25 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:10.545794 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-01ec905e-2eb1-46b0-9b7f-8adf1d5d3a25 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:10.546658 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-01ec905e-2eb1-46b0-9b7f-8adf1d5d3a25 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:10.547098 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-01ec905e-2eb1-46b0-9b7f-8adf1d5d3a25 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:10.547690 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-01ec905e-2eb1-46b0-9b7f-8adf1d5d3a25 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:10.680172 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-01ec905e-2eb1-46b0-9b7f-8adf1d5d3a25 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:10.688187 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-01ec905e-2eb1-46b0-9b7f-8adf1d5d3a25 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 200 len: 1521 microversion: 2.1 time: 0.155654 Aug 09 07:04:10.688755 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 149/297] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:10 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:10.743535 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-dc42226c-ac66-4cc2-bc29-88b386af4707 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:10.744183 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-dc42226c-ac66-4cc2-bc29-88b386af4707 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] [instance: a57723ea-6384-4eee-b52d-f5f86e476fb0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:10.750038 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dc42226c-ac66-4cc2-bc29-88b386af4707 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:10.750626 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dc42226c-ac66-4cc2-bc29-88b386af4707 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:10.751036 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dc42226c-ac66-4cc2-bc29-88b386af4707 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:10.751725 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dc42226c-ac66-4cc2-bc29-88b386af4707 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:10.752162 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dc42226c-ac66-4cc2-bc29-88b386af4707 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:10.752549 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dc42226c-ac66-4cc2-bc29-88b386af4707 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:10.818790 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-dc42226c-ac66-4cc2-bc29-88b386af4707 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6b55d7cb1840a5ad93369589a36596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814c528dd56c4e61ae5cba5733bf2f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:10.828255 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-dc42226c-ac66-4cc2-bc29-88b386af4707 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] 10.222.0.30 "GET /compute/v2.1/servers/a57723ea-6384-4eee-b52d-f5f86e476fb0" status: 200 len: 1266 microversion: 2.1 time: 0.089093 Aug 09 07:04:10.828822 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 149/298] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:10 2022] GET /compute/v2.1/servers/a57723ea-6384-4eee-b52d-f5f86e476fb0 => generated 1266 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:11.491439 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-0203786d-a93e-40b6-8841-765f05e35d33 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:11.492223 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-0203786d-a93e-40b6-8841-765f05e35d33 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] [instance: b756c8c1-b4b0-4d12-97f6-6c229a956b28] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:11.498591 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0203786d-a93e-40b6-8841-765f05e35d33 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:11.499200 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0203786d-a93e-40b6-8841-765f05e35d33 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:11.499769 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0203786d-a93e-40b6-8841-765f05e35d33 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:11.500531 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0203786d-a93e-40b6-8841-765f05e35d33 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:11.500988 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0203786d-a93e-40b6-8841-765f05e35d33 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:11.501418 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0203786d-a93e-40b6-8841-765f05e35d33 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:11.637023 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-0203786d-a93e-40b6-8841-765f05e35d33 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e146e6da0294fa78e07d8c1e971af3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c78ed6f8b354b1b9b07151736df1386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:11.644477 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-0203786d-a93e-40b6-8841-765f05e35d33 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] 10.222.0.30 "GET /compute/v2.1/servers/b756c8c1-b4b0-4d12-97f6-6c229a956b28" status: 200 len: 1314 microversion: 2.1 time: 0.156809 Aug 09 07:04:11.645033 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 150/299] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:11 2022] GET /compute/v2.1/servers/b756c8c1-b4b0-4d12-97f6-6c229a956b28 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:11.709958 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-aba5bc67-491f-4aa1-a86a-7e086065a64c tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:11.710784 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-aba5bc67-491f-4aa1-a86a-7e086065a64c tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:11.717182 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aba5bc67-491f-4aa1-a86a-7e086065a64c tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:11.717664 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aba5bc67-491f-4aa1-a86a-7e086065a64c tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:11.718098 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aba5bc67-491f-4aa1-a86a-7e086065a64c tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:11.718788 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aba5bc67-491f-4aa1-a86a-7e086065a64c tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:11.719368 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aba5bc67-491f-4aa1-a86a-7e086065a64c tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:11.719848 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aba5bc67-491f-4aa1-a86a-7e086065a64c tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:11.849299 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-1f3cb64d-39b5-4e07-9894-2ab6ea97d99e tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:11.850084 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-1f3cb64d-39b5-4e07-9894-2ab6ea97d99e tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] [instance: a57723ea-6384-4eee-b52d-f5f86e476fb0] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:11.854666 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-aba5bc67-491f-4aa1-a86a-7e086065a64c tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:11.864071 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-aba5bc67-491f-4aa1-a86a-7e086065a64c tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 200 len: 1501 microversion: 2.1 time: 0.157937 Aug 09 07:04:11.864650 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 150/300] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:11 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 1501 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:11.870489 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1f3cb64d-39b5-4e07-9894-2ab6ea97d99e tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:11.871060 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1f3cb64d-39b5-4e07-9894-2ab6ea97d99e tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:11.871573 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1f3cb64d-39b5-4e07-9894-2ab6ea97d99e tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:11.872364 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1f3cb64d-39b5-4e07-9894-2ab6ea97d99e tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:11.872903 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1f3cb64d-39b5-4e07-9894-2ab6ea97d99e tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:11.873395 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1f3cb64d-39b5-4e07-9894-2ab6ea97d99e tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:11.885064 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-84d1f3c4-dc0e-47c7-9696-cf118f9146ba tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:11.885804 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-84d1f3c4-dc0e-47c7-9696-cf118f9146ba tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 9fe62967-63ba-4d67-88c4-25e1c1d445fa] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:11.892976 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-84d1f3c4-dc0e-47c7-9696-cf118f9146ba tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:11.893520 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-84d1f3c4-dc0e-47c7-9696-cf118f9146ba tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:11.894163 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-84d1f3c4-dc0e-47c7-9696-cf118f9146ba tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:11.894889 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-84d1f3c4-dc0e-47c7-9696-cf118f9146ba tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:11.895342 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-84d1f3c4-dc0e-47c7-9696-cf118f9146ba tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:11.895798 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-84d1f3c4-dc0e-47c7-9696-cf118f9146ba tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:11.944357 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-1f3cb64d-39b5-4e07-9894-2ab6ea97d99e tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6b55d7cb1840a5ad93369589a36596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814c528dd56c4e61ae5cba5733bf2f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:11.953945 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-1f3cb64d-39b5-4e07-9894-2ab6ea97d99e tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] 10.222.0.30 "GET /compute/v2.1/servers/a57723ea-6384-4eee-b52d-f5f86e476fb0" status: 200 len: 1274 microversion: 2.1 time: 0.109009 Aug 09 07:04:11.968301 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 151/301] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:11 2022] GET /compute/v2.1/servers/a57723ea-6384-4eee-b52d-f5f86e476fb0 => generated 1274 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:04:12.216319 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-84d1f3c4-dc0e-47c7-9696-cf118f9146ba tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:12.224705 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-84d1f3c4-dc0e-47c7-9696-cf118f9146ba tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa" status: 200 len: 1517 microversion: 2.1 time: 0.343214 Aug 09 07:04:12.225639 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 151/302] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:11 2022] GET /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa => generated 1517 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:04:12.665983 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-0ff7713e-f69a-4d00-88e5-2f7a5b8d1c1f tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:12.666636 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-0ff7713e-f69a-4d00-88e5-2f7a5b8d1c1f tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] [instance: b756c8c1-b4b0-4d12-97f6-6c229a956b28] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:12.672675 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0ff7713e-f69a-4d00-88e5-2f7a5b8d1c1f tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:12.673156 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0ff7713e-f69a-4d00-88e5-2f7a5b8d1c1f tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:12.673587 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0ff7713e-f69a-4d00-88e5-2f7a5b8d1c1f tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:12.674301 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0ff7713e-f69a-4d00-88e5-2f7a5b8d1c1f tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:12.674750 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0ff7713e-f69a-4d00-88e5-2f7a5b8d1c1f tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:12.675173 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0ff7713e-f69a-4d00-88e5-2f7a5b8d1c1f tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:12.805426 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-0ff7713e-f69a-4d00-88e5-2f7a5b8d1c1f tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e146e6da0294fa78e07d8c1e971af3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c78ed6f8b354b1b9b07151736df1386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:12.812813 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-0ff7713e-f69a-4d00-88e5-2f7a5b8d1c1f tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] 10.222.0.30 "GET /compute/v2.1/servers/b756c8c1-b4b0-4d12-97f6-6c229a956b28" status: 200 len: 1314 microversion: 2.1 time: 0.151272 Aug 09 07:04:12.813377 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 152/303] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:12 2022] GET /compute/v2.1/servers/b756c8c1-b4b0-4d12-97f6-6c229a956b28 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:12.975756 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4cf9dfe3-14b6-4c12-b03f-a467db24cd25 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:12.976410 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4cf9dfe3-14b6-4c12-b03f-a467db24cd25 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] [instance: a57723ea-6384-4eee-b52d-f5f86e476fb0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:12.982791 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4cf9dfe3-14b6-4c12-b03f-a467db24cd25 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:12.983445 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4cf9dfe3-14b6-4c12-b03f-a467db24cd25 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:12.983856 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4cf9dfe3-14b6-4c12-b03f-a467db24cd25 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:12.984545 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4cf9dfe3-14b6-4c12-b03f-a467db24cd25 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:12.985002 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4cf9dfe3-14b6-4c12-b03f-a467db24cd25 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:12.985430 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4cf9dfe3-14b6-4c12-b03f-a467db24cd25 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:13.121017 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4cf9dfe3-14b6-4c12-b03f-a467db24cd25 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6b55d7cb1840a5ad93369589a36596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814c528dd56c4e61ae5cba5733bf2f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:13.128467 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4cf9dfe3-14b6-4c12-b03f-a467db24cd25 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] 10.222.0.30 "GET /compute/v2.1/servers/a57723ea-6384-4eee-b52d-f5f86e476fb0" status: 200 len: 1314 microversion: 2.1 time: 0.156583 Aug 09 07:04:13.129023 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 152/304] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:12 2022] GET /compute/v2.1/servers/a57723ea-6384-4eee-b52d-f5f86e476fb0 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:13.647531 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-b293ae58-5ca0-4c7a-ba3a-54a7c12c76ad tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:04:13.650648 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-b293ae58-5ca0-4c7a-ba3a-54a7c12c76ad tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 9fe62967-63ba-4d67-88c4-25e1c1d445fa] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:13.656689 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b293ae58-5ca0-4c7a-ba3a-54a7c12c76ad tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:13.657182 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b293ae58-5ca0-4c7a-ba3a-54a7c12c76ad tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:13.657621 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b293ae58-5ca0-4c7a-ba3a-54a7c12c76ad tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:13.658330 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b293ae58-5ca0-4c7a-ba3a-54a7c12c76ad tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:13.658786 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b293ae58-5ca0-4c7a-ba3a-54a7c12c76ad tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:13.659210 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b293ae58-5ca0-4c7a-ba3a-54a7c12c76ad tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:13.685380 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.objects.instance [None req-b293ae58-5ca0-4c7a-ba3a-54a7c12c76ad tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lazy-loading 'flavor' on Instance uuid 9fe62967-63ba-4d67-88c4-25e1c1d445fa {{(pid=117858) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 07:04:13.779766 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-b293ae58-5ca0-4c7a-ba3a-54a7c12c76ad tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "POST /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa/action" status: 200 len: 32 microversion: 2.1 time: 0.137087 Aug 09 07:04:13.780249 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 153/305] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 9 07:04:13 2022] POST /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa/action => generated 32 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 07:04:13.795108 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-1419cd2c-6c8d-4184-9a03-9727ed64d47a tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:13.797733 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-1419cd2c-6c8d-4184-9a03-9727ed64d47a tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 9fe62967-63ba-4d67-88c4-25e1c1d445fa] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:13.809986 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1419cd2c-6c8d-4184-9a03-9727ed64d47a tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:13.811215 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1419cd2c-6c8d-4184-9a03-9727ed64d47a tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:13.811882 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1419cd2c-6c8d-4184-9a03-9727ed64d47a tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:13.813200 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1419cd2c-6c8d-4184-9a03-9727ed64d47a tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:13.813815 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1419cd2c-6c8d-4184-9a03-9727ed64d47a tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:13.814406 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1419cd2c-6c8d-4184-9a03-9727ed64d47a tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:13.843348 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-9ee5a8cd-6c70-4e99-b6cd-8e61187199ba tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:13.844642 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-9ee5a8cd-6c70-4e99-b6cd-8e61187199ba tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] [instance: b756c8c1-b4b0-4d12-97f6-6c229a956b28] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:13.853315 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9ee5a8cd-6c70-4e99-b6cd-8e61187199ba tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:13.854116 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9ee5a8cd-6c70-4e99-b6cd-8e61187199ba tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:13.854827 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9ee5a8cd-6c70-4e99-b6cd-8e61187199ba tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:13.856362 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9ee5a8cd-6c70-4e99-b6cd-8e61187199ba tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:13.859264 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9ee5a8cd-6c70-4e99-b6cd-8e61187199ba tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:13.860109 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9ee5a8cd-6c70-4e99-b6cd-8e61187199ba tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:14.067352 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-1419cd2c-6c8d-4184-9a03-9727ed64d47a tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:14.075340 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-9ee5a8cd-6c70-4e99-b6cd-8e61187199ba tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e146e6da0294fa78e07d8c1e971af3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c78ed6f8b354b1b9b07151736df1386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:14.076492 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-1419cd2c-6c8d-4184-9a03-9727ed64d47a tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa" status: 200 len: 1523 microversion: 2.1 time: 0.290396 Aug 09 07:04:14.077141 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 153/306] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:13 2022] GET /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa => generated 1523 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:14.092597 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-9ee5a8cd-6c70-4e99-b6cd-8e61187199ba tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] 10.222.0.30 "GET /compute/v2.1/servers/b756c8c1-b4b0-4d12-97f6-6c229a956b28" status: 200 len: 1314 microversion: 2.1 time: 0.261432 Aug 09 07:04:14.093182 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 154/307] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:13 2022] GET /compute/v2.1/servers/b756c8c1-b4b0-4d12-97f6-6c229a956b28 => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:14.151357 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b3963e8d-fe82-4122-ab52-667a53b33309 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:14.151997 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b3963e8d-fe82-4122-ab52-667a53b33309 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] [instance: a57723ea-6384-4eee-b52d-f5f86e476fb0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:14.157856 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b3963e8d-fe82-4122-ab52-667a53b33309 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:14.158337 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b3963e8d-fe82-4122-ab52-667a53b33309 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:14.158790 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b3963e8d-fe82-4122-ab52-667a53b33309 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:14.159483 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b3963e8d-fe82-4122-ab52-667a53b33309 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:14.159963 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b3963e8d-fe82-4122-ab52-667a53b33309 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:14.160626 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b3963e8d-fe82-4122-ab52-667a53b33309 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:14.328776 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [req-cdf04fae-4b95-4799-acf3-1d3ed49c2f8e req-afb59853-a9e5-4003-84c8-ce1b526bc7d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a57723ea-6384-4eee-b52d-f5f86e476fb0", "tag": "b2959c39-1706-42da-a61f-7c09f4e85084"}]} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:04:14.332419 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b3963e8d-fe82-4122-ab52-667a53b33309 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6b55d7cb1840a5ad93369589a36596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814c528dd56c4e61ae5cba5733bf2f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:14.344047 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b3963e8d-fe82-4122-ab52-667a53b33309 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] 10.222.0.30 "GET /compute/v2.1/servers/a57723ea-6384-4eee-b52d-f5f86e476fb0" status: 200 len: 1314 microversion: 2.1 time: 0.197213 Aug 09 07:04:14.355932 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 154/308] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:14 2022] GET /compute/v2.1/servers/a57723ea-6384-4eee-b52d-f5f86e476fb0 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:14.356028 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-cdf04fae-4b95-4799-acf3-1d3ed49c2f8e req-afb59853-a9e5-4003-84c8-ce1b526bc7d9 service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:14.356028 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-cdf04fae-4b95-4799-acf3-1d3ed49c2f8e req-afb59853-a9e5-4003-84c8-ce1b526bc7d9 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:14.356028 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-cdf04fae-4b95-4799-acf3-1d3ed49c2f8e req-afb59853-a9e5-4003-84c8-ce1b526bc7d9 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:14.359656 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.compute.server_external_events [req-cdf04fae-4b95-4799-acf3-1d3ed49c2f8e req-afb59853-a9e5-4003-84c8-ce1b526bc7d9 service nova] Creating event network-changed:b2959c39-1706-42da-a61f-7c09f4e85084 for instance a57723ea-6384-4eee-b52d-f5f86e476fb0 on hv-cinder-85251 Aug 09 07:04:14.365252 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [req-cdf04fae-4b95-4799-acf3-1d3ed49c2f8e req-afb59853-a9e5-4003-84c8-ce1b526bc7d9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040766 Aug 09 07:04:14.367008 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 155/309] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:04:15.097445 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e1690d1a-b824-484a-9ccd-d1072814f8b8 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:15.098056 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-e1690d1a-b824-484a-9ccd-d1072814f8b8 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 9fe62967-63ba-4d67-88c4-25e1c1d445fa] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:15.104449 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e1690d1a-b824-484a-9ccd-d1072814f8b8 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:15.104934 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e1690d1a-b824-484a-9ccd-d1072814f8b8 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:15.105376 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e1690d1a-b824-484a-9ccd-d1072814f8b8 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:15.106075 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e1690d1a-b824-484a-9ccd-d1072814f8b8 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:15.106531 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e1690d1a-b824-484a-9ccd-d1072814f8b8 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:15.106960 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e1690d1a-b824-484a-9ccd-d1072814f8b8 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:15.113739 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-2bf59fcf-c7ec-4261-ab2a-19c3e4dda6b2 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:15.114429 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-2bf59fcf-c7ec-4261-ab2a-19c3e4dda6b2 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] [instance: b756c8c1-b4b0-4d12-97f6-6c229a956b28] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:15.121970 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2bf59fcf-c7ec-4261-ab2a-19c3e4dda6b2 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:15.122451 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2bf59fcf-c7ec-4261-ab2a-19c3e4dda6b2 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:15.122881 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2bf59fcf-c7ec-4261-ab2a-19c3e4dda6b2 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:15.123568 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2bf59fcf-c7ec-4261-ab2a-19c3e4dda6b2 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:15.124038 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2bf59fcf-c7ec-4261-ab2a-19c3e4dda6b2 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:15.124456 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2bf59fcf-c7ec-4261-ab2a-19c3e4dda6b2 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:15.319304 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e1690d1a-b824-484a-9ccd-d1072814f8b8 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:15.324261 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-2bf59fcf-c7ec-4261-ab2a-19c3e4dda6b2 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e146e6da0294fa78e07d8c1e971af3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c78ed6f8b354b1b9b07151736df1386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:15.328553 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-e1690d1a-b824-484a-9ccd-d1072814f8b8 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa" status: 200 len: 1523 microversion: 2.1 time: 0.234891 Aug 09 07:04:15.329307 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 155/310] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:15 2022] GET /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa => generated 1523 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:15.331614 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-2bf59fcf-c7ec-4261-ab2a-19c3e4dda6b2 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] 10.222.0.30 "GET /compute/v2.1/servers/b756c8c1-b4b0-4d12-97f6-6c229a956b28" status: 200 len: 1314 microversion: 2.1 time: 0.222427 Aug 09 07:04:15.332447 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 156/311] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:15 2022] GET /compute/v2.1/servers/b756c8c1-b4b0-4d12-97f6-6c229a956b28 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:04:15.369363 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-0ac29e32-fe89-40c3-ae28-f6c2316e4fcf tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:15.369974 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-0ac29e32-fe89-40c3-ae28-f6c2316e4fcf tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] [instance: a57723ea-6384-4eee-b52d-f5f86e476fb0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:15.376075 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0ac29e32-fe89-40c3-ae28-f6c2316e4fcf tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:15.376562 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0ac29e32-fe89-40c3-ae28-f6c2316e4fcf tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:15.377081 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0ac29e32-fe89-40c3-ae28-f6c2316e4fcf tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:15.377779 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0ac29e32-fe89-40c3-ae28-f6c2316e4fcf tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:15.378231 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0ac29e32-fe89-40c3-ae28-f6c2316e4fcf tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:15.378657 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0ac29e32-fe89-40c3-ae28-f6c2316e4fcf tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:15.513644 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-0ac29e32-fe89-40c3-ae28-f6c2316e4fcf tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6b55d7cb1840a5ad93369589a36596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814c528dd56c4e61ae5cba5733bf2f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:15.521487 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-0ac29e32-fe89-40c3-ae28-f6c2316e4fcf tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] 10.222.0.30 "GET /compute/v2.1/servers/a57723ea-6384-4eee-b52d-f5f86e476fb0" status: 200 len: 1314 microversion: 2.1 time: 0.156369 Aug 09 07:04:15.522044 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 156/312] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:15 2022] GET /compute/v2.1/servers/a57723ea-6384-4eee-b52d-f5f86e476fb0 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:16.351562 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-4b276687-212d-4283-bfec-1d605eee13e9 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:16.352470 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-4b276687-212d-4283-bfec-1d605eee13e9 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 9fe62967-63ba-4d67-88c4-25e1c1d445fa] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:16.352714 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b475ce24-9046-4103-b39a-e688f101e956 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:16.353330 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b475ce24-9046-4103-b39a-e688f101e956 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] [instance: b756c8c1-b4b0-4d12-97f6-6c229a956b28] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:16.359093 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4b276687-212d-4283-bfec-1d605eee13e9 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:16.359751 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4b276687-212d-4283-bfec-1d605eee13e9 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:16.360280 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4b276687-212d-4283-bfec-1d605eee13e9 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:16.361075 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4b276687-212d-4283-bfec-1d605eee13e9 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:16.361768 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4b276687-212d-4283-bfec-1d605eee13e9 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:16.362408 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4b276687-212d-4283-bfec-1d605eee13e9 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:16.370104 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b475ce24-9046-4103-b39a-e688f101e956 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:16.370799 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b475ce24-9046-4103-b39a-e688f101e956 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:16.371721 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b475ce24-9046-4103-b39a-e688f101e956 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:16.373852 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b475ce24-9046-4103-b39a-e688f101e956 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:16.375398 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b475ce24-9046-4103-b39a-e688f101e956 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:16.376027 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b475ce24-9046-4103-b39a-e688f101e956 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:16.584484 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-4b276687-212d-4283-bfec-1d605eee13e9 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:16.592290 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b475ce24-9046-4103-b39a-e688f101e956 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e146e6da0294fa78e07d8c1e971af3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c78ed6f8b354b1b9b07151736df1386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:16.593759 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-4b276687-212d-4283-bfec-1d605eee13e9 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa" status: 200 len: 1523 microversion: 2.1 time: 0.247152 Aug 09 07:04:16.603983 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b475ce24-9046-4103-b39a-e688f101e956 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] 10.222.0.30 "GET /compute/v2.1/servers/b756c8c1-b4b0-4d12-97f6-6c229a956b28" status: 200 len: 1314 microversion: 2.1 time: 0.255475 Aug 09 07:04:16.603983 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 157/313] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:16 2022] GET /compute/v2.1/servers/b756c8c1-b4b0-4d12-97f6-6c229a956b28 => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:04:16.608500 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 157/314] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:16 2022] GET /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa => generated 1523 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:16.618858 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-fe17a205-4cf0-43cc-928f-7ecece5286aa tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:16.619849 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-fe17a205-4cf0-43cc-928f-7ecece5286aa tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] [instance: a57723ea-6384-4eee-b52d-f5f86e476fb0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:16.625985 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fe17a205-4cf0-43cc-928f-7ecece5286aa tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:16.626550 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fe17a205-4cf0-43cc-928f-7ecece5286aa tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:16.627041 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fe17a205-4cf0-43cc-928f-7ecece5286aa tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:16.627927 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fe17a205-4cf0-43cc-928f-7ecece5286aa tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:16.628379 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fe17a205-4cf0-43cc-928f-7ecece5286aa tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:16.628794 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fe17a205-4cf0-43cc-928f-7ecece5286aa tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:16.780592 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-fe17a205-4cf0-43cc-928f-7ecece5286aa tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6b55d7cb1840a5ad93369589a36596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814c528dd56c4e61ae5cba5733bf2f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:16.784878 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=100 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:04:16.793378 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-fe17a205-4cf0-43cc-928f-7ecece5286aa tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] 10.222.0.30 "GET /compute/v2.1/servers/a57723ea-6384-4eee-b52d-f5f86e476fb0" status: 200 len: 1314 microversion: 2.1 time: 0.187232 Aug 09 07:04:16.793961 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 158/315] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:16 2022] GET /compute/v2.1/servers/a57723ea-6384-4eee-b52d-f5f86e476fb0 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:17.617754 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-22b284d4-9098-4a11-98b1-8e176371bab3 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:17.619291 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-22b284d4-9098-4a11-98b1-8e176371bab3 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 9fe62967-63ba-4d67-88c4-25e1c1d445fa] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:17.628563 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-22b284d4-9098-4a11-98b1-8e176371bab3 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:17.629681 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-22b284d4-9098-4a11-98b1-8e176371bab3 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:17.630793 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-22b284d4-9098-4a11-98b1-8e176371bab3 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:17.630988 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-98cb22c6-0a5b-4725-b7f8-a95e78d2467f tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:17.632828 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-22b284d4-9098-4a11-98b1-8e176371bab3 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:17.633441 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-98cb22c6-0a5b-4725-b7f8-a95e78d2467f tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] [instance: b756c8c1-b4b0-4d12-97f6-6c229a956b28] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:17.634106 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-22b284d4-9098-4a11-98b1-8e176371bab3 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:17.634753 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-22b284d4-9098-4a11-98b1-8e176371bab3 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:17.654025 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-98cb22c6-0a5b-4725-b7f8-a95e78d2467f tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:17.654523 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-98cb22c6-0a5b-4725-b7f8-a95e78d2467f tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:17.655017 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-98cb22c6-0a5b-4725-b7f8-a95e78d2467f tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:17.655701 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-98cb22c6-0a5b-4725-b7f8-a95e78d2467f tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:17.656327 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-98cb22c6-0a5b-4725-b7f8-a95e78d2467f tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:17.656758 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-98cb22c6-0a5b-4725-b7f8-a95e78d2467f tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:17.868883 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-22b284d4-9098-4a11-98b1-8e176371bab3 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:17.872274 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-98cb22c6-0a5b-4725-b7f8-a95e78d2467f tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e146e6da0294fa78e07d8c1e971af3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c78ed6f8b354b1b9b07151736df1386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:17.877922 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-22b284d4-9098-4a11-98b1-8e176371bab3 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa" status: 200 len: 1523 microversion: 2.1 time: 0.265427 Aug 09 07:04:17.878597 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 158/316] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:17 2022] GET /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa => generated 1523 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:17.881025 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-98cb22c6-0a5b-4725-b7f8-a95e78d2467f tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] 10.222.0.30 "GET /compute/v2.1/servers/b756c8c1-b4b0-4d12-97f6-6c229a956b28" status: 200 len: 1314 microversion: 2.1 time: 0.256087 Aug 09 07:04:17.882174 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 159/317] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:17 2022] GET /compute/v2.1/servers/b756c8c1-b4b0-4d12-97f6-6c229a956b28 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:17.884099 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-0d4df02f-c127-4f65-a234-9483791f463b tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:17.884887 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-0d4df02f-c127-4f65-a234-9483791f463b tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] [instance: a57723ea-6384-4eee-b52d-f5f86e476fb0] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:17.891422 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0d4df02f-c127-4f65-a234-9483791f463b tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:17.892116 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0d4df02f-c127-4f65-a234-9483791f463b tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:17.892723 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0d4df02f-c127-4f65-a234-9483791f463b tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:17.893602 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0d4df02f-c127-4f65-a234-9483791f463b tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:17.894060 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0d4df02f-c127-4f65-a234-9483791f463b tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:17.894479 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0d4df02f-c127-4f65-a234-9483791f463b tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:17.978628 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-ce5717bf-4570-456f-9b4a-4a08daf434e5 req-a5e71c06-1166-4d0d-ba9f-7747eecc684f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b756c8c1-b4b0-4d12-97f6-6c229a956b28", "name": "network-vif-plugged", "status": "completed", "tag": "1189049f-9e27-4536-8c98-b0ede4a6d15a"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:04:17.993136 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-ce5717bf-4570-456f-9b4a-4a08daf434e5 req-a5e71c06-1166-4d0d-ba9f-7747eecc684f service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:17.993607 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-ce5717bf-4570-456f-9b4a-4a08daf434e5 req-a5e71c06-1166-4d0d-ba9f-7747eecc684f service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:17.994030 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-ce5717bf-4570-456f-9b4a-4a08daf434e5 req-a5e71c06-1166-4d0d-ba9f-7747eecc684f service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:18.010135 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-ce5717bf-4570-456f-9b4a-4a08daf434e5 req-a5e71c06-1166-4d0d-ba9f-7747eecc684f service nova] Creating event network-vif-plugged:1189049f-9e27-4536-8c98-b0ede4a6d15a for instance b756c8c1-b4b0-4d12-97f6-6c229a956b28 on hv-cinder-85251 Aug 09 07:04:18.016635 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-ce5717bf-4570-456f-9b4a-4a08daf434e5 req-a5e71c06-1166-4d0d-ba9f-7747eecc684f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043097 Aug 09 07:04:18.017283 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 160/318] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:04:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 07:04:18.044413 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-0d4df02f-c127-4f65-a234-9483791f463b tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6b55d7cb1840a5ad93369589a36596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814c528dd56c4e61ae5cba5733bf2f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:18.052303 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-0d4df02f-c127-4f65-a234-9483791f463b tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] 10.222.0.30 "GET /compute/v2.1/servers/a57723ea-6384-4eee-b52d-f5f86e476fb0" status: 200 len: 1314 microversion: 2.1 time: 0.171891 Aug 09 07:04:18.053701 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 159/319] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:17 2022] GET /compute/v2.1/servers/a57723ea-6384-4eee-b52d-f5f86e476fb0 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:18.900854 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e553111a-ca98-4e26-b8dc-fd640046447c tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:18.901406 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-f57ebda8-32f2-43f0-9661-67156aaf068f tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:18.901765 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-e553111a-ca98-4e26-b8dc-fd640046447c tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 9fe62967-63ba-4d67-88c4-25e1c1d445fa] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:18.901857 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-f57ebda8-32f2-43f0-9661-67156aaf068f tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] [instance: b756c8c1-b4b0-4d12-97f6-6c229a956b28] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:18.907892 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f57ebda8-32f2-43f0-9661-67156aaf068f tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:18.908146 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e553111a-ca98-4e26-b8dc-fd640046447c tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:18.908378 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f57ebda8-32f2-43f0-9661-67156aaf068f tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:18.908786 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e553111a-ca98-4e26-b8dc-fd640046447c tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:18.909136 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f57ebda8-32f2-43f0-9661-67156aaf068f tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:18.909303 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e553111a-ca98-4e26-b8dc-fd640046447c tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:18.909485 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f57ebda8-32f2-43f0-9661-67156aaf068f tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:18.909939 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f57ebda8-32f2-43f0-9661-67156aaf068f tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:18.910101 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e553111a-ca98-4e26-b8dc-fd640046447c tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:18.910352 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f57ebda8-32f2-43f0-9661-67156aaf068f tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:18.910559 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e553111a-ca98-4e26-b8dc-fd640046447c tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:18.911015 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e553111a-ca98-4e26-b8dc-fd640046447c tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:19.099224 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-f57ebda8-32f2-43f0-9661-67156aaf068f tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e146e6da0294fa78e07d8c1e971af3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c78ed6f8b354b1b9b07151736df1386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:19.106849 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-f57ebda8-32f2-43f0-9661-67156aaf068f tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] 10.222.0.30 "GET /compute/v2.1/servers/b756c8c1-b4b0-4d12-97f6-6c229a956b28" status: 200 len: 1314 microversion: 2.1 time: 0.209625 Aug 09 07:04:19.107670 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 160/320] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:18 2022] GET /compute/v2.1/servers/b756c8c1-b4b0-4d12-97f6-6c229a956b28 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:04:19.110422 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e553111a-ca98-4e26-b8dc-fd640046447c tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:19.111960 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-889f6368-e556-451b-a949-1973da60b966 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:19.112622 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-889f6368-e556-451b-a949-1973da60b966 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] [instance: a57723ea-6384-4eee-b52d-f5f86e476fb0] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:19.118953 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-889f6368-e556-451b-a949-1973da60b966 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:19.119429 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-889f6368-e556-451b-a949-1973da60b966 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:19.119868 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-e553111a-ca98-4e26-b8dc-fd640046447c tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa" status: 200 len: 1523 microversion: 2.1 time: 0.223570 Aug 09 07:04:19.119977 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-889f6368-e556-451b-a949-1973da60b966 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:19.120560 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-889f6368-e556-451b-a949-1973da60b966 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:19.125657 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 161/321] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:18 2022] GET /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa => generated 1523 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:19.125806 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-889f6368-e556-451b-a949-1973da60b966 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:19.125806 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-889f6368-e556-451b-a949-1973da60b966 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:19.253090 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-889f6368-e556-451b-a949-1973da60b966 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6b55d7cb1840a5ad93369589a36596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814c528dd56c4e61ae5cba5733bf2f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:19.255638 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:04:19.261895 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-889f6368-e556-451b-a949-1973da60b966 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] 10.222.0.30 "GET /compute/v2.1/servers/a57723ea-6384-4eee-b52d-f5f86e476fb0" status: 200 len: 1314 microversion: 2.1 time: 0.153445 Aug 09 07:04:19.262453 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 161/322] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:19 2022] GET /compute/v2.1/servers/a57723ea-6384-4eee-b52d-f5f86e476fb0 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:20.063377 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-5eb68dfc-1d8f-4183-b0b2-66972adb6687 req-4a4aa608-a6b3-43a2-a7f3-3b6a58bba72e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a57723ea-6384-4eee-b52d-f5f86e476fb0", "name": "network-vif-plugged", "status": "completed", "tag": "b2959c39-1706-42da-a61f-7c09f4e85084"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:04:20.079532 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=2 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:04:20.088210 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=6 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:04:20.096048 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-5eb68dfc-1d8f-4183-b0b2-66972adb6687 req-4a4aa608-a6b3-43a2-a7f3-3b6a58bba72e service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:20.096608 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-5eb68dfc-1d8f-4183-b0b2-66972adb6687 req-4a4aa608-a6b3-43a2-a7f3-3b6a58bba72e service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:20.097253 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-5eb68dfc-1d8f-4183-b0b2-66972adb6687 req-4a4aa608-a6b3-43a2-a7f3-3b6a58bba72e service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:20.109520 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-5eb68dfc-1d8f-4183-b0b2-66972adb6687 req-4a4aa608-a6b3-43a2-a7f3-3b6a58bba72e service nova] Creating event network-vif-plugged:b2959c39-1706-42da-a61f-7c09f4e85084 for instance a57723ea-6384-4eee-b52d-f5f86e476fb0 on hv-cinder-85251 Aug 09 07:04:20.114826 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-5eb68dfc-1d8f-4183-b0b2-66972adb6687 req-4a4aa608-a6b3-43a2-a7f3-3b6a58bba72e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055193 Aug 09 07:04:20.115434 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 162/323] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:04:20.126994 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_cell0:SELECT=2 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:04:20.132704 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-1d094c4f-7e3d-483a-8738-58a7d82a556a tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:20.134258 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-1d094c4f-7e3d-483a-8738-58a7d82a556a tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] [instance: b756c8c1-b4b0-4d12-97f6-6c229a956b28] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:20.140785 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_api:SELECT=82 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:04:20.142315 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1d094c4f-7e3d-483a-8738-58a7d82a556a tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:20.143071 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1d094c4f-7e3d-483a-8738-58a7d82a556a tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:20.150224 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-59844896-a232-407d-a62c-0f4aa4732a14 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:20.150224 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-59844896-a232-407d-a62c-0f4aa4732a14 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 9fe62967-63ba-4d67-88c4-25e1c1d445fa] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:20.153709 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-59844896-a232-407d-a62c-0f4aa4732a14 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:20.155023 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-59844896-a232-407d-a62c-0f4aa4732a14 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:20.156119 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-59844896-a232-407d-a62c-0f4aa4732a14 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:20.157258 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-59844896-a232-407d-a62c-0f4aa4732a14 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:20.158931 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-59844896-a232-407d-a62c-0f4aa4732a14 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:20.159662 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-59844896-a232-407d-a62c-0f4aa4732a14 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:20.160078 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1d094c4f-7e3d-483a-8738-58a7d82a556a tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:20.164913 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1d094c4f-7e3d-483a-8738-58a7d82a556a tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:20.165701 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1d094c4f-7e3d-483a-8738-58a7d82a556a tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:20.167879 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1d094c4f-7e3d-483a-8738-58a7d82a556a tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:20.334562 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-59844896-a232-407d-a62c-0f4aa4732a14 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:20.346640 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-59844896-a232-407d-a62c-0f4aa4732a14 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa" status: 200 len: 1523 microversion: 2.1 time: 0.207944 Aug 09 07:04:20.347557 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 163/324] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:20 2022] GET /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa => generated 1523 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:04:20.369917 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-7f34d464-819a-4a70-b41f-28b8f755d4ac tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:20.370607 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-7f34d464-819a-4a70-b41f-28b8f755d4ac tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] [instance: a57723ea-6384-4eee-b52d-f5f86e476fb0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:20.376943 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7f34d464-819a-4a70-b41f-28b8f755d4ac tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:20.377652 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7f34d464-819a-4a70-b41f-28b8f755d4ac tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:20.378082 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7f34d464-819a-4a70-b41f-28b8f755d4ac tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:20.378774 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7f34d464-819a-4a70-b41f-28b8f755d4ac tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:20.379491 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7f34d464-819a-4a70-b41f-28b8f755d4ac tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:20.379935 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7f34d464-819a-4a70-b41f-28b8f755d4ac tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:20.540429 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-1d094c4f-7e3d-483a-8738-58a7d82a556a tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e146e6da0294fa78e07d8c1e971af3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c78ed6f8b354b1b9b07151736df1386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:20.549103 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-1d094c4f-7e3d-483a-8738-58a7d82a556a tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] 10.222.0.30 "GET /compute/v2.1/servers/b756c8c1-b4b0-4d12-97f6-6c229a956b28" status: 200 len: 1464 microversion: 2.1 time: 0.424250 Aug 09 07:04:20.549896 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 162/325] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:20 2022] GET /compute/v2.1/servers/b756c8c1-b4b0-4d12-97f6-6c229a956b28 => generated 1464 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:20.572033 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-7f34d464-819a-4a70-b41f-28b8f755d4ac tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6b55d7cb1840a5ad93369589a36596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814c528dd56c4e61ae5cba5733bf2f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:20.580932 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-7f34d464-819a-4a70-b41f-28b8f755d4ac tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] 10.222.0.30 "GET /compute/v2.1/servers/a57723ea-6384-4eee-b52d-f5f86e476fb0" status: 200 len: 1314 microversion: 2.1 time: 0.218408 Aug 09 07:04:20.581511 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 164/326] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:20 2022] GET /compute/v2.1/servers/a57723ea-6384-4eee-b52d-f5f86e476fb0 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:20.598708 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-130ea0ba-7f46-4042-9dc3-bd90222bb113 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:20.599211 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-130ea0ba-7f46-4042-9dc3-bd90222bb113 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] [instance: b756c8c1-b4b0-4d12-97f6-6c229a956b28] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:20.606716 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-130ea0ba-7f46-4042-9dc3-bd90222bb113 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:20.607279 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-130ea0ba-7f46-4042-9dc3-bd90222bb113 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:20.607757 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-130ea0ba-7f46-4042-9dc3-bd90222bb113 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:20.608463 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-130ea0ba-7f46-4042-9dc3-bd90222bb113 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:20.608923 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-130ea0ba-7f46-4042-9dc3-bd90222bb113 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:20.609346 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-130ea0ba-7f46-4042-9dc3-bd90222bb113 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:20.635932 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-130ea0ba-7f46-4042-9dc3-bd90222bb113 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] [instance: b756c8c1-b4b0-4d12-97f6-6c229a956b28] Going to try to terminate instance {{(pid=117858) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 07:04:20.712998 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-130ea0ba-7f46-4042-9dc3-bd90222bb113 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b756c8c1-b4b0-4d12-97f6-6c229a956b28" status: 204 len: 0 microversion: 2.1 time: 0.118043 Aug 09 07:04:20.713598 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 163/327] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 9 07:04:20 2022] DELETE /compute/v2.1/servers/b756c8c1-b4b0-4d12-97f6-6c229a956b28 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 07:04:20.722329 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e0a10179-fc0e-4962-8d92-d9fc38640291 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:20.723026 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-e0a10179-fc0e-4962-8d92-d9fc38640291 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] [instance: b756c8c1-b4b0-4d12-97f6-6c229a956b28] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:20.729953 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e0a10179-fc0e-4962-8d92-d9fc38640291 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:20.730438 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e0a10179-fc0e-4962-8d92-d9fc38640291 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:20.730894 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e0a10179-fc0e-4962-8d92-d9fc38640291 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:20.731756 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e0a10179-fc0e-4962-8d92-d9fc38640291 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:20.732214 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e0a10179-fc0e-4962-8d92-d9fc38640291 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:20.732637 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e0a10179-fc0e-4962-8d92-d9fc38640291 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:20.869324 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e0a10179-fc0e-4962-8d92-d9fc38640291 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e146e6da0294fa78e07d8c1e971af3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c78ed6f8b354b1b9b07151736df1386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:20.877445 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-e0a10179-fc0e-4962-8d92-d9fc38640291 tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] 10.222.0.30 "GET /compute/v2.1/servers/b756c8c1-b4b0-4d12-97f6-6c229a956b28" status: 200 len: 1470 microversion: 2.1 time: 0.158885 Aug 09 07:04:20.883525 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 165/328] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:20 2022] GET /compute/v2.1/servers/b756c8c1-b4b0-4d12-97f6-6c229a956b28 => generated 1470 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:21.375147 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-27071344-554d-4de9-aca8-d0da7e5f84c2 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:21.375868 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-27071344-554d-4de9-aca8-d0da7e5f84c2 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 9fe62967-63ba-4d67-88c4-25e1c1d445fa] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:21.382870 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-27071344-554d-4de9-aca8-d0da7e5f84c2 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:21.383813 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-27071344-554d-4de9-aca8-d0da7e5f84c2 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:21.384355 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-27071344-554d-4de9-aca8-d0da7e5f84c2 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:21.385294 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-27071344-554d-4de9-aca8-d0da7e5f84c2 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:21.386106 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-27071344-554d-4de9-aca8-d0da7e5f84c2 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:21.386619 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-27071344-554d-4de9-aca8-d0da7e5f84c2 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:21.549127 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-27071344-554d-4de9-aca8-d0da7e5f84c2 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:21.559055 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-27071344-554d-4de9-aca8-d0da7e5f84c2 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa" status: 200 len: 1523 microversion: 2.1 time: 0.188384 Aug 09 07:04:21.559648 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 164/329] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:21 2022] GET /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa => generated 1523 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:21.602890 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-364b1246-d152-4eff-8fbc-5b5123959e9d tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:21.603532 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-364b1246-d152-4eff-8fbc-5b5123959e9d tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] [instance: a57723ea-6384-4eee-b52d-f5f86e476fb0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:21.610176 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-364b1246-d152-4eff-8fbc-5b5123959e9d tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:21.610671 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-364b1246-d152-4eff-8fbc-5b5123959e9d tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:21.611274 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-364b1246-d152-4eff-8fbc-5b5123959e9d tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:21.612268 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-364b1246-d152-4eff-8fbc-5b5123959e9d tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:21.612757 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-364b1246-d152-4eff-8fbc-5b5123959e9d tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:21.613120 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-364b1246-d152-4eff-8fbc-5b5123959e9d tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:21.749592 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-364b1246-d152-4eff-8fbc-5b5123959e9d tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6b55d7cb1840a5ad93369589a36596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814c528dd56c4e61ae5cba5733bf2f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:21.757596 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-364b1246-d152-4eff-8fbc-5b5123959e9d tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] 10.222.0.30 "GET /compute/v2.1/servers/a57723ea-6384-4eee-b52d-f5f86e476fb0" status: 200 len: 1314 microversion: 2.1 time: 0.159966 Aug 09 07:04:21.758832 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 166/330] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:21 2022] GET /compute/v2.1/servers/a57723ea-6384-4eee-b52d-f5f86e476fb0 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:21.898007 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-b1bf6c3d-c169-41cc-ae2e-aece690ed48f tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:21.898621 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-b1bf6c3d-c169-41cc-ae2e-aece690ed48f tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] [instance: b756c8c1-b4b0-4d12-97f6-6c229a956b28] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:21.904493 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b1bf6c3d-c169-41cc-ae2e-aece690ed48f tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:21.904967 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b1bf6c3d-c169-41cc-ae2e-aece690ed48f tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:21.905396 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b1bf6c3d-c169-41cc-ae2e-aece690ed48f tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:21.906081 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b1bf6c3d-c169-41cc-ae2e-aece690ed48f tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:21.906530 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b1bf6c3d-c169-41cc-ae2e-aece690ed48f tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:21.906956 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b1bf6c3d-c169-41cc-ae2e-aece690ed48f tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:22.046731 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-b1bf6c3d-c169-41cc-ae2e-aece690ed48f tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e146e6da0294fa78e07d8c1e971af3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c78ed6f8b354b1b9b07151736df1386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:22.053581 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-b1bf6c3d-c169-41cc-ae2e-aece690ed48f tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] 10.222.0.30 "GET /compute/v2.1/servers/b756c8c1-b4b0-4d12-97f6-6c229a956b28" status: 200 len: 1470 microversion: 2.1 time: 0.159310 Aug 09 07:04:22.059825 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 165/331] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:21 2022] GET /compute/v2.1/servers/b756c8c1-b4b0-4d12-97f6-6c229a956b28 => generated 1470 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:22.580527 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4da77fd3-69ad-4d83-854d-3fab9c4b9d2f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:22.581055 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4da77fd3-69ad-4d83-854d-3fab9c4b9d2f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 9fe62967-63ba-4d67-88c4-25e1c1d445fa] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:22.587481 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4da77fd3-69ad-4d83-854d-3fab9c4b9d2f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:22.588004 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4da77fd3-69ad-4d83-854d-3fab9c4b9d2f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:22.588433 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4da77fd3-69ad-4d83-854d-3fab9c4b9d2f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:22.589288 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4da77fd3-69ad-4d83-854d-3fab9c4b9d2f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:22.589745 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4da77fd3-69ad-4d83-854d-3fab9c4b9d2f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:22.590165 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4da77fd3-69ad-4d83-854d-3fab9c4b9d2f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:22.737009 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4da77fd3-69ad-4d83-854d-3fab9c4b9d2f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:22.745401 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4da77fd3-69ad-4d83-854d-3fab9c4b9d2f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa" status: 200 len: 1523 microversion: 2.1 time: 0.168690 Aug 09 07:04:22.745949 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 167/332] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:22 2022] GET /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:22.781080 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-23bc144c-df09-4c7a-9896-bd05808994a8 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:22.781869 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-23bc144c-df09-4c7a-9896-bd05808994a8 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] [instance: a57723ea-6384-4eee-b52d-f5f86e476fb0] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:22.788519 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-23bc144c-df09-4c7a-9896-bd05808994a8 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:22.789011 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-23bc144c-df09-4c7a-9896-bd05808994a8 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:22.790111 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-23bc144c-df09-4c7a-9896-bd05808994a8 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:22.790818 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-23bc144c-df09-4c7a-9896-bd05808994a8 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:22.791273 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-23bc144c-df09-4c7a-9896-bd05808994a8 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:22.791732 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-23bc144c-df09-4c7a-9896-bd05808994a8 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:22.965442 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-23bc144c-df09-4c7a-9896-bd05808994a8 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6b55d7cb1840a5ad93369589a36596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814c528dd56c4e61ae5cba5733bf2f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:22.974926 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-23bc144c-df09-4c7a-9896-bd05808994a8 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] 10.222.0.30 "GET /compute/v2.1/servers/a57723ea-6384-4eee-b52d-f5f86e476fb0" status: 200 len: 1314 microversion: 2.1 time: 0.197023 Aug 09 07:04:22.975757 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 166/333] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:22 2022] GET /compute/v2.1/servers/a57723ea-6384-4eee-b52d-f5f86e476fb0 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:23.077203 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-be2b69ef-6aef-410f-abe3-895cef881e8d tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:23.078808 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-be2b69ef-6aef-410f-abe3-895cef881e8d tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] [instance: b756c8c1-b4b0-4d12-97f6-6c229a956b28] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:23.088636 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-be2b69ef-6aef-410f-abe3-895cef881e8d tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:23.089709 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-be2b69ef-6aef-410f-abe3-895cef881e8d tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:23.090344 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-be2b69ef-6aef-410f-abe3-895cef881e8d tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:23.091361 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-be2b69ef-6aef-410f-abe3-895cef881e8d tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:23.092267 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-be2b69ef-6aef-410f-abe3-895cef881e8d tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:23.093974 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-be2b69ef-6aef-410f-abe3-895cef881e8d tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:23.258643 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-be2b69ef-6aef-410f-abe3-895cef881e8d tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e146e6da0294fa78e07d8c1e971af3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c78ed6f8b354b1b9b07151736df1386', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:23.269629 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-be2b69ef-6aef-410f-abe3-895cef881e8d tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] 10.222.0.30 "GET /compute/v2.1/servers/b756c8c1-b4b0-4d12-97f6-6c229a956b28" status: 200 len: 1470 microversion: 2.1 time: 0.197911 Aug 09 07:04:23.271047 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 168/334] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:23 2022] GET /compute/v2.1/servers/b756c8c1-b4b0-4d12-97f6-6c229a956b28 => generated 1470 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:23.449981 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [req-ddfa3ea1-6e99-4d74-981e-e2542bab6baa req-10f5b7be-4908-4372-9fe3-68517c1bae99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b756c8c1-b4b0-4d12-97f6-6c229a956b28", "name": "network-vif-deleted", "tag": "1189049f-9e27-4536-8c98-b0ede4a6d15a"}]} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:04:23.462306 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-ddfa3ea1-6e99-4d74-981e-e2542bab6baa req-10f5b7be-4908-4372-9fe3-68517c1bae99 service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:23.463376 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-ddfa3ea1-6e99-4d74-981e-e2542bab6baa req-10f5b7be-4908-4372-9fe3-68517c1bae99 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:23.463959 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-ddfa3ea1-6e99-4d74-981e-e2542bab6baa req-10f5b7be-4908-4372-9fe3-68517c1bae99 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:23.479426 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.compute.server_external_events [req-ddfa3ea1-6e99-4d74-981e-e2542bab6baa req-10f5b7be-4908-4372-9fe3-68517c1bae99 service nova] Creating event network-vif-deleted:1189049f-9e27-4536-8c98-b0ede4a6d15a for instance b756c8c1-b4b0-4d12-97f6-6c229a956b28 on hv-cinder-85251 Aug 09 07:04:23.486211 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [req-ddfa3ea1-6e99-4d74-981e-e2542bab6baa req-10f5b7be-4908-4372-9fe3-68517c1bae99 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041544 Aug 09 07:04:23.486953 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 167/335] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:04:23.766232 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-72e0ca0e-755f-4007-90ac-73aad9ba0d1e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:23.766849 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-72e0ca0e-755f-4007-90ac-73aad9ba0d1e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 9fe62967-63ba-4d67-88c4-25e1c1d445fa] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:23.782471 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-72e0ca0e-755f-4007-90ac-73aad9ba0d1e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:23.782959 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-72e0ca0e-755f-4007-90ac-73aad9ba0d1e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:23.783392 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-72e0ca0e-755f-4007-90ac-73aad9ba0d1e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:23.784123 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-72e0ca0e-755f-4007-90ac-73aad9ba0d1e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:23.784577 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-72e0ca0e-755f-4007-90ac-73aad9ba0d1e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:23.785006 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-72e0ca0e-755f-4007-90ac-73aad9ba0d1e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:23.931416 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-72e0ca0e-755f-4007-90ac-73aad9ba0d1e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:23.938837 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-72e0ca0e-755f-4007-90ac-73aad9ba0d1e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa" status: 200 len: 1523 microversion: 2.1 time: 0.176472 Aug 09 07:04:23.943088 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 169/336] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:23 2022] GET /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:23.997499 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-d7d9133c-2a9b-4ae6-8ca6-bf9b87dd746f tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:23.998191 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-d7d9133c-2a9b-4ae6-8ca6-bf9b87dd746f tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] [instance: a57723ea-6384-4eee-b52d-f5f86e476fb0] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:24.005694 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d7d9133c-2a9b-4ae6-8ca6-bf9b87dd746f tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:24.006185 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d7d9133c-2a9b-4ae6-8ca6-bf9b87dd746f tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:24.006627 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d7d9133c-2a9b-4ae6-8ca6-bf9b87dd746f tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:24.007329 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d7d9133c-2a9b-4ae6-8ca6-bf9b87dd746f tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:24.007843 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d7d9133c-2a9b-4ae6-8ca6-bf9b87dd746f tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:24.008276 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d7d9133c-2a9b-4ae6-8ca6-bf9b87dd746f tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:24.172991 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-d7d9133c-2a9b-4ae6-8ca6-bf9b87dd746f tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6b55d7cb1840a5ad93369589a36596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814c528dd56c4e61ae5cba5733bf2f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:24.181694 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-d7d9133c-2a9b-4ae6-8ca6-bf9b87dd746f tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] 10.222.0.30 "GET /compute/v2.1/servers/a57723ea-6384-4eee-b52d-f5f86e476fb0" status: 200 len: 1497 microversion: 2.1 time: 0.189391 Aug 09 07:04:24.182483 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 168/337] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:23 2022] GET /compute/v2.1/servers/a57723ea-6384-4eee-b52d-f5f86e476fb0 => generated 1497 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:24.291586 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d0d3b81f-6ce9-48c4-a314-ed315ec2c53b tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:24.292474 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-d0d3b81f-6ce9-48c4-a314-ed315ec2c53b tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] [instance: b756c8c1-b4b0-4d12-97f6-6c229a956b28] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:24.295765 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:04:24.299303 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d0d3b81f-6ce9-48c4-a314-ed315ec2c53b tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:24.299903 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d0d3b81f-6ce9-48c4-a314-ed315ec2c53b tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:24.300346 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d0d3b81f-6ce9-48c4-a314-ed315ec2c53b tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:24.301109 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d0d3b81f-6ce9-48c4-a314-ed315ec2c53b tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:24.301569 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d0d3b81f-6ce9-48c4-a314-ed315ec2c53b tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:24.302017 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d0d3b81f-6ce9-48c4-a314-ed315ec2c53b tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:24.317656 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-d0d3b81f-6ce9-48c4-a314-ed315ec2c53b tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] HTTP exception thrown: Instance b756c8c1-b4b0-4d12-97f6-6c229a956b28 could not be found. Aug 09 07:04:24.319245 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d0d3b81f-6ce9-48c4-a314-ed315ec2c53b tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Request method failure captured: Aug 09 07:04:24.319245 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/b756c8c1-b4b0-4d12-97f6-6c229a956b28 HTTP/1.1 Aug 09 07:04:24.319245 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 09 07:04:24.319245 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 09 07:04:24.319245 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Connection: close Aug 09 07:04:24.319245 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Length: 0 Aug 09 07:04:24.319245 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 09 07:04:24.319245 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.30 Aug 09 07:04:24.319245 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 09 07:04:24.319245 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.11 Aug 09 07:04:24.319245 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi8gbcYVCV6KMxYwGBqGyRaUzpiWV63oWRnP6mPe8zs7bODQlXv_npbD5VwcJf5kAvkGrzg7ao_aHEVBJqpF825QymB4FbVkG8zHNVx85nl1uWeDxVB2QmEeCTX-iCz2zUTeMhCApbSHGCkYrSJWEuBbILdq2CQVrUxtcO_EY4meh76DU Aug 09 07:04:24.319245 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 09 07:04:24.319245 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 09 07:04:24.319245 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 09 07:04:24.319245 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 09 07:04:24.319245 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 09 07:04:24.319245 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 09 07:04:24.319245 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Id: 8c78ed6f8b354b1b9b07151736df1386 Aug 09 07:04:24.319245 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-VolumesNegativeTest-1803003125 Aug 09 07:04:24.319245 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 09 07:04:24.319245 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 09 07:04:24.321364 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8c78ed6f8b354b1b9b07151736df1386"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_8c78ed6f8b354b1b9b07151736df1386"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/8c78ed6f8b354b1b9b07151736df1386"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/8c78ed6f8b354b1b9b07151736df1386"}]}] Aug 09 07:04:24.321364 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-VolumesNegativeTest-1803003125 Aug 09 07:04:24.321364 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: 8c78ed6f8b354b1b9b07151736df1386 Aug 09 07:04:24.321364 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-VolumesNegativeTest-1803003125 Aug 09 07:04:24.321364 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User: tempest-VolumesNegativeTest-1803003125-project Aug 09 07:04:24.321364 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 09 07:04:24.321364 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 09 07:04:24.321364 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Id: 3e146e6da0294fa78e07d8c1e971af3e Aug 09 07:04:24.321364 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-VolumesNegativeTest-1803003125-project Aug 09 07:04:24.321364 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: method: > Aug 09 07:04:24.321364 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: exception: Instance b756c8c1-b4b0-4d12-97f6-6c229a956b28 could not be found. Aug 09 07:04:24.321364 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: action_args: {'id': 'b756c8c1-b4b0-4d12-97f6-6c229a956b28'} Aug 09 07:04:24.322132 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 07:04:24.322132 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:04:24.322132 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 07:04:24.322132 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 07:04:24.322132 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 07:04:24.322132 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 07:04:24.322132 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 07:04:24.322132 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 07:04:24.322132 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 07:04:24.322132 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 07:04:24.322132 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b756c8c1-b4b0-4d12-97f6-6c229a956b28 could not be found. Aug 09 07:04:24.322132 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:04:24.322132 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:04:24.322132 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:04:24.322132 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:04:24.322132 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:04:24.322132 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:04:24.322132 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 07:04:24.322132 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 07:04:24.322132 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 07:04:24.323269 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 07:04:24.323269 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 07:04:24.323269 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 07:04:24.323269 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 07:04:24.323269 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 07:04:24.323269 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 07:04:24.323269 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 07:04:24.323269 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b756c8c1-b4b0-4d12-97f6-6c229a956b28 could not be found. Aug 09 07:04:24.323269 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:04:24.323269 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:04:24.323269 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:04:24.323269 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:04:24.323269 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:04:24.323269 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:04:24.323269 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 07:04:24.323269 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 07:04:24.323269 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b756c8c1-b4b0-4d12-97f6-6c229a956b28 could not be found. Aug 09 07:04:24.323269 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:04:24.324464 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d0d3b81f-6ce9-48c4-a314-ed315ec2c53b tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] Returning 404 to user: Instance b756c8c1-b4b0-4d12-97f6-6c229a956b28 could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 07:04:24.324464 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-d0d3b81f-6ce9-48c4-a314-ed315ec2c53b tempest-VolumesNegativeTest-1803003125 tempest-VolumesNegativeTest-1803003125-project] 10.222.0.30 "GET /compute/v2.1/servers/b756c8c1-b4b0-4d12-97f6-6c229a956b28" status: 404 len: 111 microversion: 2.1 time: 0.033819 Aug 09 07:04:24.324464 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 170/338] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:24 2022] GET /compute/v2.1/servers/b756c8c1-b4b0-4d12-97f6-6c229a956b28 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 07:04:24.802780 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-3ec8cb58-50af-4a01-b9ea-895257386063 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:24.803288 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-3ec8cb58-50af-4a01-b9ea-895257386063 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] [instance: a57723ea-6384-4eee-b52d-f5f86e476fb0] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:24.823653 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3ec8cb58-50af-4a01-b9ea-895257386063 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:24.823653 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3ec8cb58-50af-4a01-b9ea-895257386063 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:24.823653 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3ec8cb58-50af-4a01-b9ea-895257386063 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:24.823653 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3ec8cb58-50af-4a01-b9ea-895257386063 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:24.827376 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3ec8cb58-50af-4a01-b9ea-895257386063 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:24.828860 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3ec8cb58-50af-4a01-b9ea-895257386063 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:24.872506 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-3ec8cb58-50af-4a01-b9ea-895257386063 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] [instance: a57723ea-6384-4eee-b52d-f5f86e476fb0] Going to try to terminate instance {{(pid=117858) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 07:04:24.966475 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-3fb465f8-2bec-488a-a29e-cce98b288ecf tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:24.967097 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-3fb465f8-2bec-488a-a29e-cce98b288ecf tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 9fe62967-63ba-4d67-88c4-25e1c1d445fa] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:24.996038 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-3ec8cb58-50af-4a01-b9ea-895257386063 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] 10.222.0.30 "DELETE /compute/v2.1/servers/a57723ea-6384-4eee-b52d-f5f86e476fb0" status: 204 len: 0 microversion: 2.1 time: 0.203700 Aug 09 07:04:24.998270 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 169/339] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 9 07:04:24 2022] DELETE /compute/v2.1/servers/a57723ea-6384-4eee-b52d-f5f86e476fb0 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 07:04:25.003062 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3fb465f8-2bec-488a-a29e-cce98b288ecf tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:25.003062 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3fb465f8-2bec-488a-a29e-cce98b288ecf tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:25.003062 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3fb465f8-2bec-488a-a29e-cce98b288ecf tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:25.003657 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3fb465f8-2bec-488a-a29e-cce98b288ecf tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:25.006281 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3fb465f8-2bec-488a-a29e-cce98b288ecf tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:25.007050 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3fb465f8-2bec-488a-a29e-cce98b288ecf tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:25.012974 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-a1691761-72a4-435a-a6f4-375edfde74b0 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:25.013756 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-a1691761-72a4-435a-a6f4-375edfde74b0 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] [instance: a57723ea-6384-4eee-b52d-f5f86e476fb0] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:25.020433 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a1691761-72a4-435a-a6f4-375edfde74b0 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:25.021876 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a1691761-72a4-435a-a6f4-375edfde74b0 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:25.022598 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a1691761-72a4-435a-a6f4-375edfde74b0 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:25.024060 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a1691761-72a4-435a-a6f4-375edfde74b0 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:25.024686 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a1691761-72a4-435a-a6f4-375edfde74b0 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:25.025541 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a1691761-72a4-435a-a6f4-375edfde74b0 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:25.231190 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-3fb465f8-2bec-488a-a29e-cce98b288ecf tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:25.240426 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-3fb465f8-2bec-488a-a29e-cce98b288ecf tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa" status: 200 len: 1523 microversion: 2.1 time: 0.282660 Aug 09 07:04:25.240998 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 171/340] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:24 2022] GET /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa => generated 1523 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:25.272625 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-a1691761-72a4-435a-a6f4-375edfde74b0 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6b55d7cb1840a5ad93369589a36596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814c528dd56c4e61ae5cba5733bf2f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:25.281340 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-a1691761-72a4-435a-a6f4-375edfde74b0 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] 10.222.0.30 "GET /compute/v2.1/servers/a57723ea-6384-4eee-b52d-f5f86e476fb0" status: 200 len: 1503 microversion: 2.1 time: 0.275649 Aug 09 07:04:25.282298 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 170/341] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:25 2022] GET /compute/v2.1/servers/a57723ea-6384-4eee-b52d-f5f86e476fb0 => generated 1503 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:26.262757 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-8dae1333-32db-43c8-b8d5-39b103f6cae0 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:26.263639 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-8dae1333-32db-43c8-b8d5-39b103f6cae0 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 9fe62967-63ba-4d67-88c4-25e1c1d445fa] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:26.270519 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8dae1333-32db-43c8-b8d5-39b103f6cae0 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:26.271174 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8dae1333-32db-43c8-b8d5-39b103f6cae0 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:26.271644 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8dae1333-32db-43c8-b8d5-39b103f6cae0 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:26.272371 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8dae1333-32db-43c8-b8d5-39b103f6cae0 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:26.272826 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8dae1333-32db-43c8-b8d5-39b103f6cae0 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:26.273258 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8dae1333-32db-43c8-b8d5-39b103f6cae0 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:26.302298 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-bf2cccff-2b26-44a9-8468-af868b7d43c3 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:26.303107 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-bf2cccff-2b26-44a9-8468-af868b7d43c3 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] [instance: a57723ea-6384-4eee-b52d-f5f86e476fb0] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:26.314207 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-bf2cccff-2b26-44a9-8468-af868b7d43c3 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:26.314964 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-bf2cccff-2b26-44a9-8468-af868b7d43c3 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:26.325021 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-bf2cccff-2b26-44a9-8468-af868b7d43c3 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:26.325892 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-bf2cccff-2b26-44a9-8468-af868b7d43c3 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:26.326471 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-bf2cccff-2b26-44a9-8468-af868b7d43c3 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:26.326963 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-bf2cccff-2b26-44a9-8468-af868b7d43c3 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:26.533078 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8dae1333-32db-43c8-b8d5-39b103f6cae0 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:26.536029 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-bf2cccff-2b26-44a9-8468-af868b7d43c3 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6b55d7cb1840a5ad93369589a36596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814c528dd56c4e61ae5cba5733bf2f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:26.543990 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-8dae1333-32db-43c8-b8d5-39b103f6cae0 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa" status: 200 len: 1523 microversion: 2.1 time: 0.286373 Aug 09 07:04:26.544735 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 172/342] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:26 2022] GET /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa => generated 1523 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:26.549706 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-bf2cccff-2b26-44a9-8468-af868b7d43c3 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] 10.222.0.30 "GET /compute/v2.1/servers/a57723ea-6384-4eee-b52d-f5f86e476fb0" status: 200 len: 1503 microversion: 2.1 time: 0.251182 Aug 09 07:04:26.550536 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 171/343] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:26 2022] GET /compute/v2.1/servers/a57723ea-6384-4eee-b52d-f5f86e476fb0 => generated 1503 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:04:27.116975 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-87379f0b-2dcf-4024-ba6c-8131d5def32e req-dec4b100-9a81-475e-b852-63fd523d09e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a57723ea-6384-4eee-b52d-f5f86e476fb0", "name": "network-vif-deleted", "tag": "b2959c39-1706-42da-a61f-7c09f4e85084"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:04:27.127080 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-87379f0b-2dcf-4024-ba6c-8131d5def32e req-dec4b100-9a81-475e-b852-63fd523d09e2 service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:27.127567 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-87379f0b-2dcf-4024-ba6c-8131d5def32e req-dec4b100-9a81-475e-b852-63fd523d09e2 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:27.128026 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-87379f0b-2dcf-4024-ba6c-8131d5def32e req-dec4b100-9a81-475e-b852-63fd523d09e2 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:27.141596 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-87379f0b-2dcf-4024-ba6c-8131d5def32e req-dec4b100-9a81-475e-b852-63fd523d09e2 service nova] Creating event network-vif-deleted:b2959c39-1706-42da-a61f-7c09f4e85084 for instance a57723ea-6384-4eee-b52d-f5f86e476fb0 on hv-cinder-85251 Aug 09 07:04:27.154819 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-87379f0b-2dcf-4024-ba6c-8131d5def32e req-dec4b100-9a81-475e-b852-63fd523d09e2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036193 Aug 09 07:04:27.155798 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 173/344] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:04:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:04:27.573442 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-ef02056c-3997-4171-834e-43be7451f459 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:27.575132 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-ef02056c-3997-4171-834e-43be7451f459 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 9fe62967-63ba-4d67-88c4-25e1c1d445fa] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:27.578878 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b261e65d-55aa-43f7-aff0-5c2bf4f988f8 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:27.579650 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b261e65d-55aa-43f7-aff0-5c2bf4f988f8 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] [instance: a57723ea-6384-4eee-b52d-f5f86e476fb0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:27.589496 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b261e65d-55aa-43f7-aff0-5c2bf4f988f8 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:27.593858 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b261e65d-55aa-43f7-aff0-5c2bf4f988f8 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:27.595061 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b261e65d-55aa-43f7-aff0-5c2bf4f988f8 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:27.596377 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b261e65d-55aa-43f7-aff0-5c2bf4f988f8 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:27.597222 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b261e65d-55aa-43f7-aff0-5c2bf4f988f8 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:27.597873 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b261e65d-55aa-43f7-aff0-5c2bf4f988f8 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:27.618408 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ef02056c-3997-4171-834e-43be7451f459 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:27.620244 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ef02056c-3997-4171-834e-43be7451f459 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:27.620672 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ef02056c-3997-4171-834e-43be7451f459 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:27.621415 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ef02056c-3997-4171-834e-43be7451f459 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:27.627990 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ef02056c-3997-4171-834e-43be7451f459 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:27.629718 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ef02056c-3997-4171-834e-43be7451f459 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:27.727879 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b261e65d-55aa-43f7-aff0-5c2bf4f988f8 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6b55d7cb1840a5ad93369589a36596', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '814c528dd56c4e61ae5cba5733bf2f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:27.754279 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b261e65d-55aa-43f7-aff0-5c2bf4f988f8 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] 10.222.0.30 "GET /compute/v2.1/servers/a57723ea-6384-4eee-b52d-f5f86e476fb0" status: 200 len: 1461 microversion: 2.1 time: 0.179842 Aug 09 07:04:27.756548 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 174/345] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:27 2022] GET /compute/v2.1/servers/a57723ea-6384-4eee-b52d-f5f86e476fb0 => generated 1461 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:04:27.763001 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a570e0ca-b714-4239-9f9f-ddf954aba3f0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:27.767719 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-a570e0ca-b714-4239-9f9f-ddf954aba3f0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: 66d40f73-633e-4564-a6d4-732cd15dcb12] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:27.782799 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a570e0ca-b714-4239-9f9f-ddf954aba3f0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:27.783283 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a570e0ca-b714-4239-9f9f-ddf954aba3f0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:27.783872 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a570e0ca-b714-4239-9f9f-ddf954aba3f0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:27.784641 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a570e0ca-b714-4239-9f9f-ddf954aba3f0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:27.785168 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a570e0ca-b714-4239-9f9f-ddf954aba3f0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:27.785659 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a570e0ca-b714-4239-9f9f-ddf954aba3f0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:27.817704 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-a570e0ca-b714-4239-9f9f-ddf954aba3f0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12/ips" status: 200 len: 149 microversion: 2.1 time: 0.059540 Aug 09 07:04:27.819057 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 175/346] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Aug 9 07:04:27 2022] GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12/ips => generated 149 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:04:27.917382 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-ef02056c-3997-4171-834e-43be7451f459 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:27.926603 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-ef02056c-3997-4171-834e-43be7451f459 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa" status: 200 len: 1523 microversion: 2.1 time: 0.364996 Aug 09 07:04:27.927935 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 172/347] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:27 2022] GET /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa => generated 1523 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:28.783306 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-eb52118b-3b56-4b33-996c-2fd7d44ab579 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:28.789717 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-eb52118b-3b56-4b33-996c-2fd7d44ab579 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] [instance: a57723ea-6384-4eee-b52d-f5f86e476fb0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:28.813986 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-eb52118b-3b56-4b33-996c-2fd7d44ab579 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:28.814507 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-eb52118b-3b56-4b33-996c-2fd7d44ab579 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:28.815049 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-eb52118b-3b56-4b33-996c-2fd7d44ab579 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:28.815665 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-eb52118b-3b56-4b33-996c-2fd7d44ab579 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:28.816423 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-eb52118b-3b56-4b33-996c-2fd7d44ab579 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:28.817412 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-eb52118b-3b56-4b33-996c-2fd7d44ab579 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:28.836849 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-eb52118b-3b56-4b33-996c-2fd7d44ab579 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] HTTP exception thrown: Instance a57723ea-6384-4eee-b52d-f5f86e476fb0 could not be found. Aug 09 07:04:28.839040 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-eb52118b-3b56-4b33-996c-2fd7d44ab579 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Request method failure captured: Aug 09 07:04:28.839040 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/a57723ea-6384-4eee-b52d-f5f86e476fb0 HTTP/1.1 Aug 09 07:04:28.839040 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 09 07:04:28.839040 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 09 07:04:28.839040 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Connection: close Aug 09 07:04:28.839040 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Length: 0 Aug 09 07:04:28.839040 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 09 07:04:28.839040 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.30 Aug 09 07:04:28.839040 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 09 07:04:28.839040 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.11 Aug 09 07:04:28.839040 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi8gbA-VT_HofQdH2L2WrygQBSPDK3__NUyFlVyrGK7H7OLxcCtm4pAfiZxCe7amFxWnRgm3PZ_66-f6pQ6ox2-os-xZ-y4xylA79CBFNymBwQQ21Cf3t5FZCIoMJqPHmLw9vTVvRyjWndGFfs2wZd3XSXOJ1EfBV2Q-N2NglzShGi7Y0 Aug 09 07:04:28.839040 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 09 07:04:28.839040 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 09 07:04:28.839040 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 09 07:04:28.839040 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 09 07:04:28.839040 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 09 07:04:28.839040 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 09 07:04:28.839040 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Id: 814c528dd56c4e61ae5cba5733bf2f08 Aug 09 07:04:28.839040 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-VolumesActionsTest-1153304816 Aug 09 07:04:28.839040 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 09 07:04:28.839040 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 09 07:04:28.840503 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/814c528dd56c4e61ae5cba5733bf2f08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_814c528dd56c4e61ae5cba5733bf2f08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/814c528dd56c4e61ae5cba5733bf2f08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/814c528dd56c4e61ae5cba5733bf2f08"}]}] Aug 09 07:04:28.840503 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-VolumesActionsTest-1153304816 Aug 09 07:04:28.840503 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: 814c528dd56c4e61ae5cba5733bf2f08 Aug 09 07:04:28.840503 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-VolumesActionsTest-1153304816 Aug 09 07:04:28.840503 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User: tempest-VolumesActionsTest-1153304816-project Aug 09 07:04:28.840503 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 09 07:04:28.840503 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 09 07:04:28.840503 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Id: 2a6b55d7cb1840a5ad93369589a36596 Aug 09 07:04:28.840503 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-VolumesActionsTest-1153304816-project Aug 09 07:04:28.840503 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: method: > Aug 09 07:04:28.840503 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: exception: Instance a57723ea-6384-4eee-b52d-f5f86e476fb0 could not be found. Aug 09 07:04:28.840503 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: action_args: {'id': 'a57723ea-6384-4eee-b52d-f5f86e476fb0'} Aug 09 07:04:28.841322 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 07:04:28.841322 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:04:28.841322 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 07:04:28.841322 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 07:04:28.841322 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 07:04:28.841322 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 07:04:28.841322 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 07:04:28.841322 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 07:04:28.841322 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 07:04:28.841322 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 07:04:28.841322 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a57723ea-6384-4eee-b52d-f5f86e476fb0 could not be found. Aug 09 07:04:28.841322 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:04:28.841322 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:04:28.841322 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:04:28.841322 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:04:28.841322 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:04:28.841322 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:04:28.841322 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 07:04:28.841322 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 07:04:28.841322 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 07:04:28.842694 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 07:04:28.842694 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 07:04:28.842694 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 07:04:28.842694 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 07:04:28.842694 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 07:04:28.842694 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 07:04:28.842694 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 07:04:28.842694 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a57723ea-6384-4eee-b52d-f5f86e476fb0 could not be found. Aug 09 07:04:28.842694 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:04:28.842694 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:04:28.842694 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:04:28.842694 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:04:28.842694 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:04:28.842694 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:04:28.842694 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 07:04:28.842694 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 07:04:28.842694 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a57723ea-6384-4eee-b52d-f5f86e476fb0 could not be found. Aug 09 07:04:28.842694 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:04:28.844475 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-eb52118b-3b56-4b33-996c-2fd7d44ab579 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] Returning 404 to user: Instance a57723ea-6384-4eee-b52d-f5f86e476fb0 could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 07:04:28.844475 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-eb52118b-3b56-4b33-996c-2fd7d44ab579 tempest-VolumesActionsTest-1153304816 tempest-VolumesActionsTest-1153304816-project] 10.222.0.30 "GET /compute/v2.1/servers/a57723ea-6384-4eee-b52d-f5f86e476fb0" status: 404 len: 111 microversion: 2.1 time: 0.063352 Aug 09 07:04:28.861841 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 176/348] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:28 2022] GET /compute/v2.1/servers/a57723ea-6384-4eee-b52d-f5f86e476fb0 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 07:04:28.951190 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-341ab465-fbc4-415e-82c6-a4724ee2fc25 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:28.953191 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-341ab465-fbc4-415e-82c6-a4724ee2fc25 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 9fe62967-63ba-4d67-88c4-25e1c1d445fa] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:28.963497 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-341ab465-fbc4-415e-82c6-a4724ee2fc25 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:28.964011 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-341ab465-fbc4-415e-82c6-a4724ee2fc25 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:28.964639 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-341ab465-fbc4-415e-82c6-a4724ee2fc25 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:28.966211 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-341ab465-fbc4-415e-82c6-a4724ee2fc25 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:28.966682 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-341ab465-fbc4-415e-82c6-a4724ee2fc25 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:28.967212 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-341ab465-fbc4-415e-82c6-a4724ee2fc25 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:29.152291 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-341ab465-fbc4-415e-82c6-a4724ee2fc25 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:29.172375 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-341ab465-fbc4-415e-82c6-a4724ee2fc25 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa" status: 200 len: 1523 microversion: 2.1 time: 0.227142 Aug 09 07:04:29.172963 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 173/349] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:28 2022] GET /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa => generated 1523 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:29.478327 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-fd73ea5d-05af-4ba0-a438-f57f37a91b8b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "658e3261-9b74-4d8a-977b-770abed75cbb"}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:04:29.481059 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-fd73ea5d-05af-4ba0-a438-f57f37a91b8b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: 66d40f73-633e-4564-a6d4-732cd15dcb12] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:29.488875 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fd73ea5d-05af-4ba0-a438-f57f37a91b8b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:29.489775 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fd73ea5d-05af-4ba0-a438-f57f37a91b8b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:29.490365 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fd73ea5d-05af-4ba0-a438-f57f37a91b8b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:29.491231 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fd73ea5d-05af-4ba0-a438-f57f37a91b8b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:29.492743 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fd73ea5d-05af-4ba0-a438-f57f37a91b8b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:29.493457 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fd73ea5d-05af-4ba0-a438-f57f37a91b8b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:30.194087 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-61845c51-aab6-42bb-9e5d-5b232e5b7221 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:30.195238 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-61845c51-aab6-42bb-9e5d-5b232e5b7221 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 9fe62967-63ba-4d67-88c4-25e1c1d445fa] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:30.201729 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-61845c51-aab6-42bb-9e5d-5b232e5b7221 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:30.202450 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-61845c51-aab6-42bb-9e5d-5b232e5b7221 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:30.203296 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-61845c51-aab6-42bb-9e5d-5b232e5b7221 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:30.204468 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-61845c51-aab6-42bb-9e5d-5b232e5b7221 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:30.205473 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-61845c51-aab6-42bb-9e5d-5b232e5b7221 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:30.206084 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-61845c51-aab6-42bb-9e5d-5b232e5b7221 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:30.619132 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-61845c51-aab6-42bb-9e5d-5b232e5b7221 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:30.627379 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-61845c51-aab6-42bb-9e5d-5b232e5b7221 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa" status: 200 len: 1503 microversion: 2.1 time: 0.437030 Aug 09 07:04:30.627982 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 174/350] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:30 2022] GET /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa => generated 1503 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:04:30.659069 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-265afec7-d79a-41d1-9e61-d36573208726 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "49749bdd-b03e-4600-99a2-c37a9dd2a9f4"}} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:04:30.666245 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-265afec7-d79a-41d1-9e61-d36573208726 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 9fe62967-63ba-4d67-88c4-25e1c1d445fa] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:30.681255 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-265afec7-d79a-41d1-9e61-d36573208726 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:30.681765 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-265afec7-d79a-41d1-9e61-d36573208726 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:30.685618 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-265afec7-d79a-41d1-9e61-d36573208726 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:30.686974 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-265afec7-d79a-41d1-9e61-d36573208726 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:30.687471 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-265afec7-d79a-41d1-9e61-d36573208726 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:30.687998 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-265afec7-d79a-41d1-9e61-d36573208726 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:30.725764 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.wsgi [None req-265afec7-d79a-41d1-9e61-d36573208726 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] HTTP exception thrown: Cannot 'attach_volume' instance 9fe62967-63ba-4d67-88c4-25e1c1d445fa while it is in vm_state rescued Aug 09 07:04:30.728699 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-265afec7-d79a-41d1-9e61-d36573208726 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Request method failure captured: Aug 09 07:04:30.728699 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: request: POST /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa/os-volume_attachments HTTP/1.1 Aug 09 07:04:30.728699 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Accept: application/json Aug 09 07:04:30.728699 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Accept-Encoding: identity Aug 09 07:04:30.728699 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Connection: close Aug 09 07:04:30.728699 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Content-Length: 74 Aug 09 07:04:30.728699 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Content-Type: application/json Aug 09 07:04:30.728699 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Host: 10.222.0.30 Aug 09 07:04:30.728699 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Openstack-System-Scope: None Aug 09 07:04:30.728699 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: User-Agent: python-urllib3/1.26.11 Aug 09 07:04:30.728699 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Auth-Token: gAAAAABi8gaR68LUg4fD8olNfnhK5rGsuZLf2x3TIzuy1CUG3sPjpuV_p2f6hy7YLAChvAXkrqy9P06phVXme741Qxk922cto6wMDgT9kUn7Yz0BZVivdWCpYNCbvZ_IUlx12VWDEDp0qoNPhO2SGvBasUprpkpWeSpi9qySzJJVs0D_hnkcro8 Aug 09 07:04:30.728699 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Domain-Id: None Aug 09 07:04:30.728699 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Domain-Name: None Aug 09 07:04:30.728699 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Identity-Status: Confirmed Aug 09 07:04:30.728699 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Is-Admin-Project: True Aug 09 07:04:30.728699 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Domain-Id: default Aug 09 07:04:30.728699 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Domain-Name: Default Aug 09 07:04:30.728699 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Id: 517f3dedc5da431b87e398003506c06b Aug 09 07:04:30.728699 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1447651910 Aug 09 07:04:30.728699 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Role: reader,member Aug 09 07:04:30.728699 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Roles: reader,member Aug 09 07:04:30.730257 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/517f3dedc5da431b87e398003506c06b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_517f3dedc5da431b87e398003506c06b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/517f3dedc5da431b87e398003506c06b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/517f3dedc5da431b87e398003506c06b"}]}] Aug 09 07:04:30.730257 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1447651910 Aug 09 07:04:30.730257 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant-Id: 517f3dedc5da431b87e398003506c06b Aug 09 07:04:30.730257 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1447651910 Aug 09 07:04:30.730257 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User: tempest-ServerRescueNegativeTestJSON-1447651910-project Aug 09 07:04:30.730257 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Domain-Id: default Aug 09 07:04:30.730257 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Domain-Name: Default Aug 09 07:04:30.730257 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Id: 19da3c426c6e4c4a889ab5017804c92e Aug 09 07:04:30.730257 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1447651910-project Aug 09 07:04:30.730257 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Aug 09 07:04:30.730257 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: {"volumeAttachment": {"volumeId": "49749bdd-b03e-4600-99a2-c37a9dd2a9f4"}} Aug 09 07:04:30.730257 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: method: > Aug 09 07:04:30.731338 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: exception: Cannot 'attach_volume' instance 9fe62967-63ba-4d67-88c4-25e1c1d445fa while it is in vm_state rescued Aug 09 07:04:30.731338 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: action_args: {'server_id': '9fe62967-63ba-4d67-88c4-25e1c1d445fa', 'body': {'volumeAttachment': {'volumeId': '49749bdd-b03e-4600-99a2-c37a9dd2a9f4'}}} Aug 09 07:04:30.731338 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 07:04:30.731338 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:04:30.731338 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 09 07:04:30.731338 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 09 07:04:30.731338 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 07:04:30.731338 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 07:04:30.731338 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 09 07:04:30.731338 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 09 07:04:30.731338 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9fe62967-63ba-4d67-88c4-25e1c1d445fa in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 09 07:04:30.731338 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:04:30.731338 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:04:30.731338 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:04:30.731338 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:04:30.731338 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:04:30.731338 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:04:30.731338 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 07:04:30.731338 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 07:04:30.732712 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 07:04:30.732712 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 07:04:30.732712 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 07:04:30.732712 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 07:04:30.732712 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 07:04:30.732712 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 07:04:30.732712 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 07:04:30.732712 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 07:04:30.732712 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 09 07:04:30.732712 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 09 07:04:30.732712 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 09 07:04:30.732712 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 09 07:04:30.732712 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 9fe62967-63ba-4d67-88c4-25e1c1d445fa while it is in vm_state rescued Aug 09 07:04:30.732712 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:04:30.732712 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:04:30.732712 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:04:30.732712 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:04:30.732712 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:04:30.732712 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:04:30.733930 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 07:04:30.733930 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 07:04:30.733930 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 9fe62967-63ba-4d67-88c4-25e1c1d445fa while it is in vm_state rescued Aug 09 07:04:30.733930 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:04:30.735557 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-265afec7-d79a-41d1-9e61-d36573208726 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Returning 409 to user: Cannot 'attach_volume' instance 9fe62967-63ba-4d67-88c4-25e1c1d445fa while it is in vm_state rescued {{(pid=117858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 07:04:30.737229 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-265afec7-d79a-41d1-9e61-d36573208726 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "POST /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.086518 Aug 09 07:04:30.737948 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 175/351] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Aug 9 07:04:30 2022] POST /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa/os-volume_attachments => generated 152 bytes in 88 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 09 07:04:30.750174 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-f6ba3366-9ada-4967-b39e-4eca84d3167e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:04:30.752254 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-f6ba3366-9ada-4967-b39e-4eca84d3167e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 9fe62967-63ba-4d67-88c4-25e1c1d445fa] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:30.758863 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f6ba3366-9ada-4967-b39e-4eca84d3167e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:30.759550 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f6ba3366-9ada-4967-b39e-4eca84d3167e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:30.759820 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f6ba3366-9ada-4967-b39e-4eca84d3167e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:30.760513 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f6ba3366-9ada-4967-b39e-4eca84d3167e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:30.760951 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f6ba3366-9ada-4967-b39e-4eca84d3167e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:30.761661 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f6ba3366-9ada-4967-b39e-4eca84d3167e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:30.765920 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:04:30.842299 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-f6ba3366-9ada-4967-b39e-4eca84d3167e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "POST /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa/action" status: 202 len: 0 microversion: 2.1 time: 0.096783 Aug 09 07:04:30.842867 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 176/352] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 9 07:04:30 2022] POST /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 07:04:30.848548 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-839fc0da-2e9b-4d67-a928-b508d3309a21 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:30.849129 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-839fc0da-2e9b-4d67-a928-b508d3309a21 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:30.857412 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-839fc0da-2e9b-4d67-a928-b508d3309a21 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:30.858150 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-839fc0da-2e9b-4d67-a928-b508d3309a21 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:30.858812 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-839fc0da-2e9b-4d67-a928-b508d3309a21 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:30.859723 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-839fc0da-2e9b-4d67-a928-b508d3309a21 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:30.860363 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-839fc0da-2e9b-4d67-a928-b508d3309a21 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:30.860976 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-839fc0da-2e9b-4d67-a928-b508d3309a21 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:30.884350 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-839fc0da-2e9b-4d67-a928-b508d3309a21 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e/ips" status: 200 len: 150 microversion: 2.20 time: 0.039868 Aug 09 07:04:30.884919 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 177/353] 10.222.0.30 () {60 vars in 1289 bytes} [Tue Aug 9 07:04:30 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 07:04:30.892511 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-c0885390-962d-4e67-982a-3fb07c99191f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:30.893377 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-c0885390-962d-4e67-982a-3fb07c99191f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 9fe62967-63ba-4d67-88c4-25e1c1d445fa] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:30.901466 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c0885390-962d-4e67-982a-3fb07c99191f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:30.902740 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c0885390-962d-4e67-982a-3fb07c99191f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:30.903144 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c0885390-962d-4e67-982a-3fb07c99191f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:30.904155 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c0885390-962d-4e67-982a-3fb07c99191f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:30.904622 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c0885390-962d-4e67-982a-3fb07c99191f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:30.905046 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c0885390-962d-4e67-982a-3fb07c99191f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:31.075074 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:04:31.091834 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-c0885390-962d-4e67-982a-3fb07c99191f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:31.092486 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-fd73ea5d-05af-4ba0-a438-f57f37a91b8b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "POST /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.618030 Aug 09 07:04:31.093025 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 177/354] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Aug 9 07:04:29 2022] POST /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12/os-volume_attachments => generated 194 bytes in 1619 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:04:31.101283 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-c0885390-962d-4e67-982a-3fb07c99191f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa" status: 200 len: 1511 microversion: 2.1 time: 0.215111 Aug 09 07:04:31.108243 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 178/355] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:30 2022] GET /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa => generated 1511 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:32.125127 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4658d2ba-74f7-4599-9fb0-a838e534baa5 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:32.125912 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4658d2ba-74f7-4599-9fb0-a838e534baa5 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 9fe62967-63ba-4d67-88c4-25e1c1d445fa] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:32.133456 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4658d2ba-74f7-4599-9fb0-a838e534baa5 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:32.133970 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4658d2ba-74f7-4599-9fb0-a838e534baa5 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:32.134599 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4658d2ba-74f7-4599-9fb0-a838e534baa5 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:32.135426 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4658d2ba-74f7-4599-9fb0-a838e534baa5 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:32.135909 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4658d2ba-74f7-4599-9fb0-a838e534baa5 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:32.136500 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4658d2ba-74f7-4599-9fb0-a838e534baa5 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:32.285575 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4658d2ba-74f7-4599-9fb0-a838e534baa5 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:32.293716 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4658d2ba-74f7-4599-9fb0-a838e534baa5 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa" status: 200 len: 1511 microversion: 2.1 time: 0.173985 Aug 09 07:04:32.294284 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 178/356] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:32 2022] GET /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa => generated 1511 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:33.314349 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-0b52d43d-1c4d-4be4-a5d1-ad980d43ebd9 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:33.314889 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-0b52d43d-1c4d-4be4-a5d1-ad980d43ebd9 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 9fe62967-63ba-4d67-88c4-25e1c1d445fa] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:33.321114 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0b52d43d-1c4d-4be4-a5d1-ad980d43ebd9 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:33.321589 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0b52d43d-1c4d-4be4-a5d1-ad980d43ebd9 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:33.322048 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0b52d43d-1c4d-4be4-a5d1-ad980d43ebd9 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:33.322767 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0b52d43d-1c4d-4be4-a5d1-ad980d43ebd9 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:33.323278 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0b52d43d-1c4d-4be4-a5d1-ad980d43ebd9 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:33.323729 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0b52d43d-1c4d-4be4-a5d1-ad980d43ebd9 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:33.450207 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-0b52d43d-1c4d-4be4-a5d1-ad980d43ebd9 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:33.457551 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-0b52d43d-1c4d-4be4-a5d1-ad980d43ebd9 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa" status: 200 len: 1511 microversion: 2.1 time: 0.147092 Aug 09 07:04:33.458305 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 179/357] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:33 2022] GET /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa => generated 1511 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:34.478392 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-02bb3831-48a3-4188-a6d7-e6551e43138d tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:34.478997 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-02bb3831-48a3-4188-a6d7-e6551e43138d tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 9fe62967-63ba-4d67-88c4-25e1c1d445fa] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:34.485541 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-02bb3831-48a3-4188-a6d7-e6551e43138d tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:34.485939 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-02bb3831-48a3-4188-a6d7-e6551e43138d tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:34.486349 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-02bb3831-48a3-4188-a6d7-e6551e43138d tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:34.487072 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-02bb3831-48a3-4188-a6d7-e6551e43138d tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:34.487469 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-02bb3831-48a3-4188-a6d7-e6551e43138d tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:34.487917 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-02bb3831-48a3-4188-a6d7-e6551e43138d tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:34.668102 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-02bb3831-48a3-4188-a6d7-e6551e43138d tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:34.691840 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-02bb3831-48a3-4188-a6d7-e6551e43138d tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa" status: 200 len: 1511 microversion: 2.1 time: 0.217229 Aug 09 07:04:34.694524 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 179/358] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:34 2022] GET /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa => generated 1511 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:35.690141 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-fd59eba7-b3bc-4728-8a89-9dd90753d93c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:04:35.690743 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-fd59eba7-b3bc-4728-8a89-9dd90753d93c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:35.697750 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-fd59eba7-b3bc-4728-8a89-9dd90753d93c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:35.698233 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-fd59eba7-b3bc-4728-8a89-9dd90753d93c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:35.698663 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-fd59eba7-b3bc-4728-8a89-9dd90753d93c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:35.699358 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-fd59eba7-b3bc-4728-8a89-9dd90753d93c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:35.699850 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-fd59eba7-b3bc-4728-8a89-9dd90753d93c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:35.700295 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-fd59eba7-b3bc-4728-8a89-9dd90753d93c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:35.717328 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-bd516b79-732e-4359-857e-beba13596dce tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:35.718575 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-bd516b79-732e-4359-857e-beba13596dce tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 9fe62967-63ba-4d67-88c4-25e1c1d445fa] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:35.726830 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bd516b79-732e-4359-857e-beba13596dce tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:35.726830 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bd516b79-732e-4359-857e-beba13596dce tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:35.726830 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bd516b79-732e-4359-857e-beba13596dce tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:35.727252 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bd516b79-732e-4359-857e-beba13596dce tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:35.727512 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bd516b79-732e-4359-857e-beba13596dce tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:35.728075 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bd516b79-732e-4359-857e-beba13596dce tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:35.731610 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.objects.instance [None req-fd59eba7-b3bc-4728-8a89-9dd90753d93c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lazy-loading 'flavor' on Instance uuid 2236b6b2-39b4-4b81-bb86-006774babc2e {{(pid=117858) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 07:04:35.889715 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-bd516b79-732e-4359-857e-beba13596dce tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:35.899709 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-bd516b79-732e-4359-857e-beba13596dce tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa" status: 200 len: 1511 microversion: 2.1 time: 0.186671 Aug 09 07:04:35.900488 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 180/359] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:35 2022] GET /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa => generated 1511 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:35.943115 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-fd59eba7-b3bc-4728-8a89-9dd90753d93c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "POST /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e/action" status: 202 len: 0 microversion: 2.20 time: 0.256035 Aug 09 07:04:35.943221 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 180/360] 10.222.0.30 () {62 vars in 1319 bytes} [Tue Aug 9 07:04:35 2022] POST /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 07:04:35.952399 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-20ab3e24-6598-49c6-bd96-bee6b6218ab8 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:35.953098 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-20ab3e24-6598-49c6-bd96-bee6b6218ab8 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:35.959130 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-20ab3e24-6598-49c6-bd96-bee6b6218ab8 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:35.959632 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-20ab3e24-6598-49c6-bd96-bee6b6218ab8 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:35.960075 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-20ab3e24-6598-49c6-bd96-bee6b6218ab8 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:35.961331 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-20ab3e24-6598-49c6-bd96-bee6b6218ab8 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:35.961788 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-20ab3e24-6598-49c6-bd96-bee6b6218ab8 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:35.962211 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-20ab3e24-6598-49c6-bd96-bee6b6218ab8 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:36.100076 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-20ab3e24-6598-49c6-bd96-bee6b6218ab8 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:36.108595 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-20ab3e24-6598-49c6-bd96-bee6b6218ab8 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:36.110141 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-20ab3e24-6598-49c6-bd96-bee6b6218ab8 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:36.111297 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-20ab3e24-6598-49c6-bd96-bee6b6218ab8 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1721 microversion: 2.20 time: 0.163025 Aug 09 07:04:36.111932 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 181/361] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:04:35 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:04:36.797216 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-12c77fbe-3a0e-4860-923b-5edd5ca5d98c tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:36.797817 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-12c77fbe-3a0e-4860-923b-5edd5ca5d98c tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:36.804811 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-12c77fbe-3a0e-4860-923b-5edd5ca5d98c tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:36.805356 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-12c77fbe-3a0e-4860-923b-5edd5ca5d98c tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:36.805778 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-12c77fbe-3a0e-4860-923b-5edd5ca5d98c tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:36.806672 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-12c77fbe-3a0e-4860-923b-5edd5ca5d98c tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:36.807119 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-12c77fbe-3a0e-4860-923b-5edd5ca5d98c tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:36.807541 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-12c77fbe-3a0e-4860-923b-5edd5ca5d98c tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:36.830997 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-12c77fbe-3a0e-4860-923b-5edd5ca5d98c tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46/ips" status: 200 len: 146 microversion: 2.1 time: 0.037948 Aug 09 07:04:36.831560 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 181/362] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Aug 9 07:04:36 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:04:36.920637 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-591ce18b-bd16-40a7-8e4d-9875042bd98a tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:36.921463 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-591ce18b-bd16-40a7-8e4d-9875042bd98a tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 9fe62967-63ba-4d67-88c4-25e1c1d445fa] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:36.927801 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-591ce18b-bd16-40a7-8e4d-9875042bd98a tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:36.928405 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-591ce18b-bd16-40a7-8e4d-9875042bd98a tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:36.928888 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-591ce18b-bd16-40a7-8e4d-9875042bd98a tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:36.929708 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-591ce18b-bd16-40a7-8e4d-9875042bd98a tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:36.930266 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-591ce18b-bd16-40a7-8e4d-9875042bd98a tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:36.930692 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-591ce18b-bd16-40a7-8e4d-9875042bd98a tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:37.062513 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-591ce18b-bd16-40a7-8e4d-9875042bd98a tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:37.069991 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-591ce18b-bd16-40a7-8e4d-9875042bd98a tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa" status: 200 len: 1511 microversion: 2.1 time: 0.153117 Aug 09 07:04:37.070678 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 182/363] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:36 2022] GET /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa => generated 1511 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:37.135235 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-a352794b-3394-4eed-b4ad-973ebed162cd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:37.135930 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-a352794b-3394-4eed-b4ad-973ebed162cd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:37.141791 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a352794b-3394-4eed-b4ad-973ebed162cd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:37.142269 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a352794b-3394-4eed-b4ad-973ebed162cd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:37.142697 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a352794b-3394-4eed-b4ad-973ebed162cd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:37.143378 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a352794b-3394-4eed-b4ad-973ebed162cd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:37.143859 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a352794b-3394-4eed-b4ad-973ebed162cd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:37.144281 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a352794b-3394-4eed-b4ad-973ebed162cd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:37.271673 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-a352794b-3394-4eed-b4ad-973ebed162cd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:37.280336 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-a352794b-3394-4eed-b4ad-973ebed162cd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:37.281838 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-a352794b-3394-4eed-b4ad-973ebed162cd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:37.282987 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-a352794b-3394-4eed-b4ad-973ebed162cd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1721 microversion: 2.20 time: 0.151891 Aug 09 07:04:37.283533 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 182/364] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:04:37 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:04:38.090940 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-542600cc-426d-4de3-8fd3-108287936a00 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:38.091685 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-542600cc-426d-4de3-8fd3-108287936a00 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 9fe62967-63ba-4d67-88c4-25e1c1d445fa] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:38.098093 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-542600cc-426d-4de3-8fd3-108287936a00 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:38.098584 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-542600cc-426d-4de3-8fd3-108287936a00 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:38.099124 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-542600cc-426d-4de3-8fd3-108287936a00 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:38.099828 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-542600cc-426d-4de3-8fd3-108287936a00 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:38.100345 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-542600cc-426d-4de3-8fd3-108287936a00 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:38.100723 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-542600cc-426d-4de3-8fd3-108287936a00 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:38.239805 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-542600cc-426d-4de3-8fd3-108287936a00 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:38.248649 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-542600cc-426d-4de3-8fd3-108287936a00 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa" status: 200 len: 1511 microversion: 2.1 time: 0.161518 Aug 09 07:04:38.249497 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 183/365] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:38 2022] GET /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa => generated 1511 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:04:38.305927 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-286f21bc-4522-4f32-82f4-96f0e6bf6298 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:38.307179 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-286f21bc-4522-4f32-82f4-96f0e6bf6298 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:38.313426 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-286f21bc-4522-4f32-82f4-96f0e6bf6298 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:38.313915 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-286f21bc-4522-4f32-82f4-96f0e6bf6298 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:38.314352 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-286f21bc-4522-4f32-82f4-96f0e6bf6298 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:38.315049 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-286f21bc-4522-4f32-82f4-96f0e6bf6298 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:38.315503 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-286f21bc-4522-4f32-82f4-96f0e6bf6298 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:38.315960 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-286f21bc-4522-4f32-82f4-96f0e6bf6298 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:38.555829 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-286f21bc-4522-4f32-82f4-96f0e6bf6298 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:38.571408 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-286f21bc-4522-4f32-82f4-96f0e6bf6298 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:38.573640 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-286f21bc-4522-4f32-82f4-96f0e6bf6298 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:38.575504 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-286f21bc-4522-4f32-82f4-96f0e6bf6298 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1721 microversion: 2.20 time: 0.274094 Aug 09 07:04:38.578492 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 183/366] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:04:38 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1721 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:04:39.269517 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-77f8394d-dcbd-4dab-a58b-87e29faaadeb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:39.270121 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-77f8394d-dcbd-4dab-a58b-87e29faaadeb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 9fe62967-63ba-4d67-88c4-25e1c1d445fa] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:39.277865 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-77f8394d-dcbd-4dab-a58b-87e29faaadeb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:39.278357 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-77f8394d-dcbd-4dab-a58b-87e29faaadeb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:39.279090 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-77f8394d-dcbd-4dab-a58b-87e29faaadeb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:39.280006 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-77f8394d-dcbd-4dab-a58b-87e29faaadeb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:39.280616 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-77f8394d-dcbd-4dab-a58b-87e29faaadeb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:39.281204 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-77f8394d-dcbd-4dab-a58b-87e29faaadeb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:39.572365 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-77f8394d-dcbd-4dab-a58b-87e29faaadeb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:39.581383 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-77f8394d-dcbd-4dab-a58b-87e29faaadeb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa" status: 200 len: 1517 microversion: 2.1 time: 0.315620 Aug 09 07:04:39.582267 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 184/367] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:39 2022] GET /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa => generated 1517 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:04:39.601570 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-094b3ca2-3e35-48f8-bbd6-3ce2a9a17fad tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:39.602620 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-094b3ca2-3e35-48f8-bbd6-3ce2a9a17fad tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:39.619527 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-094b3ca2-3e35-48f8-bbd6-3ce2a9a17fad tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:39.620265 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-094b3ca2-3e35-48f8-bbd6-3ce2a9a17fad tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:39.622134 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-094b3ca2-3e35-48f8-bbd6-3ce2a9a17fad tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:39.625861 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-094b3ca2-3e35-48f8-bbd6-3ce2a9a17fad tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:39.626570 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-094b3ca2-3e35-48f8-bbd6-3ce2a9a17fad tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:39.628150 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-094b3ca2-3e35-48f8-bbd6-3ce2a9a17fad tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:39.938866 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-094b3ca2-3e35-48f8-bbd6-3ce2a9a17fad tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:39.953083 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-094b3ca2-3e35-48f8-bbd6-3ce2a9a17fad tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:39.955510 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-094b3ca2-3e35-48f8-bbd6-3ce2a9a17fad tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:39.957141 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-094b3ca2-3e35-48f8-bbd6-3ce2a9a17fad tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1721 microversion: 2.20 time: 0.359558 Aug 09 07:04:39.958534 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 184/368] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:04:39 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1721 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:04:40.987764 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-586b1287-11e3-4655-8331-f268bda41ae9 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:40.988411 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-586b1287-11e3-4655-8331-f268bda41ae9 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:40.995044 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-586b1287-11e3-4655-8331-f268bda41ae9 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:40.995527 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-586b1287-11e3-4655-8331-f268bda41ae9 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:40.996000 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-586b1287-11e3-4655-8331-f268bda41ae9 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:40.996703 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-586b1287-11e3-4655-8331-f268bda41ae9 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:40.997154 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-586b1287-11e3-4655-8331-f268bda41ae9 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:40.997603 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-586b1287-11e3-4655-8331-f268bda41ae9 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:41.165625 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-586b1287-11e3-4655-8331-f268bda41ae9 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:41.190729 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-586b1287-11e3-4655-8331-f268bda41ae9 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:41.192505 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-586b1287-11e3-4655-8331-f268bda41ae9 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:41.193676 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-586b1287-11e3-4655-8331-f268bda41ae9 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1721 microversion: 2.20 time: 0.209969 Aug 09 07:04:41.194256 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 185/369] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:04:40 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1721 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:04:42.231474 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-5364bbcd-56f2-40a4-b182-f8426b093b83 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:42.232139 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-5364bbcd-56f2-40a4-b182-f8426b093b83 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:42.260142 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5364bbcd-56f2-40a4-b182-f8426b093b83 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:42.261777 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5364bbcd-56f2-40a4-b182-f8426b093b83 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:42.262218 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5364bbcd-56f2-40a4-b182-f8426b093b83 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:42.262931 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5364bbcd-56f2-40a4-b182-f8426b093b83 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:42.263385 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5364bbcd-56f2-40a4-b182-f8426b093b83 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:42.263839 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5364bbcd-56f2-40a4-b182-f8426b093b83 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:42.420467 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-351b4ad2-56e8-4c64-9ecc-76f3b3da6a1e tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Action: 'create', calling method: .version_select at 0x7f20dd54c670>, body: {"keypair": {"name": "tempest-keypair-1195850535", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMimmc6BFpqSKhxY+4f4LkoqA9w65PmwwzKo3GNp2jgtv9z8A6P1ysd3SOTCjMJG7OHI6fZOlGg984tEblL9Ke7JvhoXxMS0yf14glU108vuq97MGNbt2K2Ly4yoNk7XA=="}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:04:42.445171 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-351b4ad2-56e8-4c64-9ecc-76f3b3da6a1e tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Getting quotas for project f38c6aa37b9643bbbe5bb7fd3efde4fd. Resources: {'key_pairs'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 07:04:42.449741 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-351b4ad2-56e8-4c64-9ecc-76f3b3da6a1e tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Getting quotas for user cc885026afe041cca086367bb67d8a9b and project f38c6aa37b9643bbbe5bb7fd3efde4fd. Resources: {'key_pairs'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 07:04:42.494814 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-351b4ad2-56e8-4c64-9ecc-76f3b3da6a1e tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.078387 Aug 09 07:04:42.498534 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 186/370] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 9 07:04:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:04:42.504796 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-5364bbcd-56f2-40a4-b182-f8426b093b83 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:42.519243 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-5364bbcd-56f2-40a4-b182-f8426b093b83 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:42.520768 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-5364bbcd-56f2-40a4-b182-f8426b093b83 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:42.521938 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-5364bbcd-56f2-40a4-b182-f8426b093b83 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1721 microversion: 2.20 time: 0.294258 Aug 09 07:04:42.522487 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 185/371] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:04:42 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1721 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:04:43.332884 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-620ff31a-fd0d-4352-8729-456b2b452a27 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "479f418a-2c46-4c4c-8875-683265e11153"}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:04:43.336379 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-620ff31a-fd0d-4352-8729-456b2b452a27 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:43.353406 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-620ff31a-fd0d-4352-8729-456b2b452a27 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:43.354739 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-620ff31a-fd0d-4352-8729-456b2b452a27 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:43.354739 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-620ff31a-fd0d-4352-8729-456b2b452a27 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:43.356711 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-620ff31a-fd0d-4352-8729-456b2b452a27 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:43.358942 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-620ff31a-fd0d-4352-8729-456b2b452a27 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:43.359586 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-620ff31a-fd0d-4352-8729-456b2b452a27 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:43.458028 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-fcf40cfa-ae8b-4041-99bc-710b7e8b20ca tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Action: 'create', calling method: .version_select at 0x7f20ddd61b80>, body: {"keypair": {"name": "tempest-keypair-757717107", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBIsJxKrAi/dCMW9VJmxVNSN61+CLCYS9QnXI/wh4JDBq5oyZaLLIoAqVNL8aEg7bc0ZkmwRUuKxxZo8o+2+DnfaFLrdRfHVs+9AazCevtZc5Lyix25d67AMDxXUGebreg=="}} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:04:43.517694 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.quota [None req-fcf40cfa-ae8b-4041-99bc-710b7e8b20ca tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Getting quotas for project 517f3dedc5da431b87e398003506c06b. Resources: {'key_pairs'} {{(pid=117858) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 07:04:43.545340 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.quota [None req-fcf40cfa-ae8b-4041-99bc-710b7e8b20ca tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Getting quotas for user 19da3c426c6e4c4a889ab5017804c92e and project 517f3dedc5da431b87e398003506c06b. Resources: {'key_pairs'} {{(pid=117858) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 07:04:43.613028 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-fcf40cfa-ae8b-4041-99bc-710b7e8b20ca tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.159158 Aug 09 07:04:43.614865 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 186/372] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 9 07:04:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:04:43.670219 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-c3cb8ff6-a3d1-4a54-b4e4-fa27de057915 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:43.676350 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-c3cb8ff6-a3d1-4a54-b4e4-fa27de057915 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:43.703723 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c3cb8ff6-a3d1-4a54-b4e4-fa27de057915 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:43.704229 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c3cb8ff6-a3d1-4a54-b4e4-fa27de057915 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:43.709346 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c3cb8ff6-a3d1-4a54-b4e4-fa27de057915 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:43.710649 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c3cb8ff6-a3d1-4a54-b4e4-fa27de057915 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:43.711436 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c3cb8ff6-a3d1-4a54-b4e4-fa27de057915 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:43.711984 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c3cb8ff6-a3d1-4a54-b4e4-fa27de057915 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:43.956802 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-620ff31a-fd0d-4352-8729-456b2b452a27 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "POST /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.627665 Aug 09 07:04:43.957789 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 187/373] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Aug 9 07:04:43 2022] POST /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46/os-volume_attachments => generated 194 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:04:44.009793 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-c3cb8ff6-a3d1-4a54-b4e4-fa27de057915 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:44.041745 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-c3cb8ff6-a3d1-4a54-b4e4-fa27de057915 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:44.045188 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-c3cb8ff6-a3d1-4a54-b4e4-fa27de057915 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:44.051498 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-c3cb8ff6-a3d1-4a54-b4e4-fa27de057915 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1721 microversion: 2.20 time: 0.435121 Aug 09 07:04:44.053148 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 187/374] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:04:43 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1721 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:04:45.079615 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-1584b18a-5e6f-4b33-8c40-b8048c4412b3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:45.080308 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-1584b18a-5e6f-4b33-8c40-b8048c4412b3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:45.094826 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1584b18a-5e6f-4b33-8c40-b8048c4412b3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:45.095571 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1584b18a-5e6f-4b33-8c40-b8048c4412b3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:45.096181 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1584b18a-5e6f-4b33-8c40-b8048c4412b3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:45.097082 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1584b18a-5e6f-4b33-8c40-b8048c4412b3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:45.099969 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1584b18a-5e6f-4b33-8c40-b8048c4412b3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:45.100564 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1584b18a-5e6f-4b33-8c40-b8048c4412b3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:45.423029 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-90e66fc5-b1a8-49b3-8a6c-e19933c54745 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-639171647", "imageRef": "5d2c35cc-2f3b-4a22-bd68-79c71882b6a2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "20e6e819-0a94-455d-a88e-5217530385f8"}], "security_groups": [{"name": "tempest-securitygroup--2011454723"}], "key_name": "tempest-keypair-1195850535", "user_data": "}} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:04:45.519842 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-1584b18a-5e6f-4b33-8c40-b8048c4412b3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:45.530090 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-1584b18a-5e6f-4b33-8c40-b8048c4412b3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:45.534926 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-1584b18a-5e6f-4b33-8c40-b8048c4412b3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:45.536510 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-1584b18a-5e6f-4b33-8c40-b8048c4412b3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1721 microversion: 2.20 time: 0.461709 Aug 09 07:04:45.537070 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 188/375] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:04:45 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1721 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 07:04:45.595654 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.network.neutron [None req-90e66fc5-b1a8-49b3-8a6c-e19933c54745 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] validate_networks() for [('20e6e819-0a94-455d-a88e-5217530385f8', None, None, None, None, None)] {{(pid=117858) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 07:04:46.254630 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.virt.hardware [None req-90e66fc5-b1a8-49b3-8a6c-e19933c54745 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Flavor limits 0:0:0 {{(pid=117858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 07:04:46.255048 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.virt.hardware [None req-90e66fc5-b1a8-49b3-8a6c-e19933c54745 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Image limits 0:0:0 {{(pid=117858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 07:04:46.255722 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.virt.hardware [None req-90e66fc5-b1a8-49b3-8a6c-e19933c54745 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Flavor pref 0:0:0 {{(pid=117858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 07:04:46.256292 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.virt.hardware [None req-90e66fc5-b1a8-49b3-8a6c-e19933c54745 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Image pref 0:0:0 {{(pid=117858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 07:04:46.257482 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.virt.hardware [None req-90e66fc5-b1a8-49b3-8a6c-e19933c54745 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 07:04:46.266800 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-90e66fc5-b1a8-49b3-8a6c-e19933c54745 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:46.267477 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-90e66fc5-b1a8-49b3-8a6c-e19933c54745 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:46.268096 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-90e66fc5-b1a8-49b3-8a6c-e19933c54745 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:46.269219 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-90e66fc5-b1a8-49b3-8a6c-e19933c54745 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:46.269822 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-90e66fc5-b1a8-49b3-8a6c-e19933c54745 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:46.270403 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-90e66fc5-b1a8-49b3-8a6c-e19933c54745 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:46.302023 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.quota [None req-90e66fc5-b1a8-49b3-8a6c-e19933c54745 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Getting quotas for project f38c6aa37b9643bbbe5bb7fd3efde4fd. Resources: {'cores', 'instances', 'ram'} {{(pid=117858) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 07:04:46.307438 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.quota [None req-90e66fc5-b1a8-49b3-8a6c-e19933c54745 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Getting quotas for user cc885026afe041cca086367bb67d8a9b and project f38c6aa37b9643bbbe5bb7fd3efde4fd. Resources: {'cores', 'instances', 'ram'} {{(pid=117858) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 07:04:46.323494 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-90e66fc5-b1a8-49b3-8a6c-e19933c54745 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Going to run 1 instances... {{(pid=117858) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 07:04:46.325787 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-90e66fc5-b1a8-49b3-8a6c-e19933c54745 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: f5e9e5b3-58c6-44f2-940a-c72b15dfd8db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5d2c35cc-2f3b-4a22-bd68-79c71882b6a2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117858) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 07:04:46.343044 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-85d0a14d-80e4-41b2-b01d-28cb9d455c87 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-497339480", "imageRef": "5d2c35cc-2f3b-4a22-bd68-79c71882b6a2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d7e85fb1-c62e-45ad-a928-60556e6bf8a9"}], "security_groups": [{"name": "tempest-securitygroup--1322872925"}], "key_name": "tempest-keypair-757717107", "user_data": "}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:04:46.380506 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-90e66fc5-b1a8-49b3-8a6c-e19933c54745 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.961900 Aug 09 07:04:46.381172 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 188/376] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 9 07:04:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 963 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 07:04:46.393337 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-618b78e3-f953-44e3-9313-4362b0a2cf90 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:46.393953 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-618b78e3-f953-44e3-9313-4362b0a2cf90 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: f5e9e5b3-58c6-44f2-940a-c72b15dfd8db] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:46.511045 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.network.neutron [None req-85d0a14d-80e4-41b2-b01d-28cb9d455c87 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] validate_networks() for [('d7e85fb1-c62e-45ad-a928-60556e6bf8a9', None, None, None, None, None)] {{(pid=117859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 07:04:46.513944 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-618b78e3-f953-44e3-9313-4362b0a2cf90 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:46.523357 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-618b78e3-f953-44e3-9313-4362b0a2cf90 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/f5e9e5b3-58c6-44f2-940a-c72b15dfd8db" status: 200 len: 1241 microversion: 2.1 time: 0.133834 Aug 09 07:04:46.526942 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 189/377] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:46 2022] GET /compute/v2.1/servers/f5e9e5b3-58c6-44f2-940a-c72b15dfd8db => generated 1241 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:04:46.558700 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-8ede0316-ee2b-4efb-94fb-03c9df40f07c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:46.559319 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-8ede0316-ee2b-4efb-94fb-03c9df40f07c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:46.573312 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-8ede0316-ee2b-4efb-94fb-03c9df40f07c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:46.574494 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-8ede0316-ee2b-4efb-94fb-03c9df40f07c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:46.575853 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-8ede0316-ee2b-4efb-94fb-03c9df40f07c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:46.579993 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-8ede0316-ee2b-4efb-94fb-03c9df40f07c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:46.581804 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-8ede0316-ee2b-4efb-94fb-03c9df40f07c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:46.582658 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-8ede0316-ee2b-4efb-94fb-03c9df40f07c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:46.840545 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-8ede0316-ee2b-4efb-94fb-03c9df40f07c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:46.855694 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-8ede0316-ee2b-4efb-94fb-03c9df40f07c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:46.857655 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-8ede0316-ee2b-4efb-94fb-03c9df40f07c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:46.859028 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-8ede0316-ee2b-4efb-94fb-03c9df40f07c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1721 microversion: 2.20 time: 0.304705 Aug 09 07:04:46.860277 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 190/378] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:04:46 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1721 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:04:47.209348 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-85d0a14d-80e4-41b2-b01d-28cb9d455c87 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Flavor limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 07:04:47.210589 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-85d0a14d-80e4-41b2-b01d-28cb9d455c87 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Image limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 07:04:47.211722 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-85d0a14d-80e4-41b2-b01d-28cb9d455c87 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Flavor pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 07:04:47.212321 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-85d0a14d-80e4-41b2-b01d-28cb9d455c87 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Image pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 07:04:47.212942 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-85d0a14d-80e4-41b2-b01d-28cb9d455c87 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 07:04:47.231104 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-85d0a14d-80e4-41b2-b01d-28cb9d455c87 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:47.232163 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-85d0a14d-80e4-41b2-b01d-28cb9d455c87 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:47.233000 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-85d0a14d-80e4-41b2-b01d-28cb9d455c87 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:47.236749 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-85d0a14d-80e4-41b2-b01d-28cb9d455c87 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:47.237481 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-85d0a14d-80e4-41b2-b01d-28cb9d455c87 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:47.238202 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-85d0a14d-80e4-41b2-b01d-28cb9d455c87 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:47.284050 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-85d0a14d-80e4-41b2-b01d-28cb9d455c87 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Getting quotas for project 517f3dedc5da431b87e398003506c06b. Resources: {'cores', 'instances', 'ram'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 07:04:47.288913 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-85d0a14d-80e4-41b2-b01d-28cb9d455c87 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Getting quotas for user 19da3c426c6e4c4a889ab5017804c92e and project 517f3dedc5da431b87e398003506c06b. Resources: {'cores', 'instances', 'ram'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 07:04:47.302631 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-85d0a14d-80e4-41b2-b01d-28cb9d455c87 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Going to run 1 instances... {{(pid=117859) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 07:04:47.305321 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-85d0a14d-80e4-41b2-b01d-28cb9d455c87 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 51b65dde-1fef-4daa-9475-7609ac03dbc3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5d2c35cc-2f3b-4a22-bd68-79c71882b6a2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 07:04:47.385549 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-85d0a14d-80e4-41b2-b01d-28cb9d455c87 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.046890 Aug 09 07:04:47.394061 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 189/379] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 9 07:04:46 2022] POST /compute/v2.1/servers => generated 409 bytes in 1056 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 07:04:47.399152 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-0cca6eb4-0424-4347-be17-b6ce4a361445 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:47.399892 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-0cca6eb4-0424-4347-be17-b6ce4a361445 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 51b65dde-1fef-4daa-9475-7609ac03dbc3] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:47.418065 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:04:47.516324 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-0cca6eb4-0424-4347-be17-b6ce4a361445 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:47.533624 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-0cca6eb4-0424-4347-be17-b6ce4a361445 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3" status: 200 len: 1244 microversion: 2.1 time: 0.139172 Aug 09 07:04:47.547799 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-3f36053e-3ffd-497b-9cdc-cce967ddbe22 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:47.548597 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-3f36053e-3ffd-497b-9cdc-cce967ddbe22 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: f5e9e5b3-58c6-44f2-940a-c72b15dfd8db] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:47.564353 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 191/380] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:47 2022] GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3 => generated 1244 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:04:47.573412 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3f36053e-3ffd-497b-9cdc-cce967ddbe22 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:47.574067 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3f36053e-3ffd-497b-9cdc-cce967ddbe22 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:47.574520 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3f36053e-3ffd-497b-9cdc-cce967ddbe22 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:47.575249 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3f36053e-3ffd-497b-9cdc-cce967ddbe22 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:47.576390 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3f36053e-3ffd-497b-9cdc-cce967ddbe22 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:47.577059 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3f36053e-3ffd-497b-9cdc-cce967ddbe22 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:47.830164 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-3f36053e-3ffd-497b-9cdc-cce967ddbe22 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:47.848996 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-3f36053e-3ffd-497b-9cdc-cce967ddbe22 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/f5e9e5b3-58c6-44f2-940a-c72b15dfd8db" status: 200 len: 1293 microversion: 2.1 time: 0.305883 Aug 09 07:04:47.849683 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 190/381] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:47 2022] GET /compute/v2.1/servers/f5e9e5b3-58c6-44f2-940a-c72b15dfd8db => generated 1293 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:47.899812 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-5109d372-fc1e-4765-a75c-fe1f147d9e59 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:47.900723 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-5109d372-fc1e-4765-a75c-fe1f147d9e59 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:47.911627 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5109d372-fc1e-4765-a75c-fe1f147d9e59 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:47.913506 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5109d372-fc1e-4765-a75c-fe1f147d9e59 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:47.914876 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5109d372-fc1e-4765-a75c-fe1f147d9e59 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:47.915905 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5109d372-fc1e-4765-a75c-fe1f147d9e59 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:47.918110 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5109d372-fc1e-4765-a75c-fe1f147d9e59 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:47.918781 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5109d372-fc1e-4765-a75c-fe1f147d9e59 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:48.218360 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-5109d372-fc1e-4765-a75c-fe1f147d9e59 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:48.281494 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-5109d372-fc1e-4765-a75c-fe1f147d9e59 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:48.284310 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-5109d372-fc1e-4765-a75c-fe1f147d9e59 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:48.286893 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-5109d372-fc1e-4765-a75c-fe1f147d9e59 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1721 microversion: 2.20 time: 0.407778 Aug 09 07:04:48.288886 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 192/382] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:04:47 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1721 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:04:48.581158 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-1e8f35d8-311e-4a32-a153-ceaec4974ce8 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:48.586745 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-1e8f35d8-311e-4a32-a153-ceaec4974ce8 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 51b65dde-1fef-4daa-9475-7609ac03dbc3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:48.605548 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1e8f35d8-311e-4a32-a153-ceaec4974ce8 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:48.608835 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1e8f35d8-311e-4a32-a153-ceaec4974ce8 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:48.608835 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1e8f35d8-311e-4a32-a153-ceaec4974ce8 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:48.608835 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1e8f35d8-311e-4a32-a153-ceaec4974ce8 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:48.608835 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1e8f35d8-311e-4a32-a153-ceaec4974ce8 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:48.628776 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1e8f35d8-311e-4a32-a153-ceaec4974ce8 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:48.807450 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-1e8f35d8-311e-4a32-a153-ceaec4974ce8 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:48.818273 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-1e8f35d8-311e-4a32-a153-ceaec4974ce8 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3" status: 200 len: 1240 microversion: 2.1 time: 0.243857 Aug 09 07:04:48.836623 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 191/383] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:48 2022] GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3 => generated 1240 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:48.874292 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-42cb7c53-941f-4f7f-8e91-2072696e4520 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:48.874905 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-42cb7c53-941f-4f7f-8e91-2072696e4520 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: f5e9e5b3-58c6-44f2-940a-c72b15dfd8db] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:48.893190 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-42cb7c53-941f-4f7f-8e91-2072696e4520 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:48.893681 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-42cb7c53-941f-4f7f-8e91-2072696e4520 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:48.894112 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-42cb7c53-941f-4f7f-8e91-2072696e4520 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:48.903942 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-42cb7c53-941f-4f7f-8e91-2072696e4520 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:48.911711 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-42cb7c53-941f-4f7f-8e91-2072696e4520 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:48.913437 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-42cb7c53-941f-4f7f-8e91-2072696e4520 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:49.034726 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-42cb7c53-941f-4f7f-8e91-2072696e4520 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:49.046057 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-42cb7c53-941f-4f7f-8e91-2072696e4520 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/f5e9e5b3-58c6-44f2-940a-c72b15dfd8db" status: 200 len: 1299 microversion: 2.1 time: 0.176699 Aug 09 07:04:49.058029 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 193/384] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:48 2022] GET /compute/v2.1/servers/f5e9e5b3-58c6-44f2-940a-c72b15dfd8db => generated 1299 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:49.314993 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-55b10c00-f6ce-441a-a262-0e8ff87c3d62 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:49.316141 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-55b10c00-f6ce-441a-a262-0e8ff87c3d62 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:49.325781 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-55b10c00-f6ce-441a-a262-0e8ff87c3d62 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:49.328206 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-55b10c00-f6ce-441a-a262-0e8ff87c3d62 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:49.329780 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-55b10c00-f6ce-441a-a262-0e8ff87c3d62 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:49.331112 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-55b10c00-f6ce-441a-a262-0e8ff87c3d62 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:49.331850 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-55b10c00-f6ce-441a-a262-0e8ff87c3d62 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:49.334000 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-55b10c00-f6ce-441a-a262-0e8ff87c3d62 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:49.686423 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-55b10c00-f6ce-441a-a262-0e8ff87c3d62 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:49.711525 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-55b10c00-f6ce-441a-a262-0e8ff87c3d62 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:49.713878 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-55b10c00-f6ce-441a-a262-0e8ff87c3d62 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:49.717374 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-55b10c00-f6ce-441a-a262-0e8ff87c3d62 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1721 microversion: 2.20 time: 0.409943 Aug 09 07:04:49.747152 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 192/385] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:04:49 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1721 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 07:04:49.842080 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-7a650361-02ed-4cf5-bcbe-65d8f746c73d tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:49.842962 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-7a650361-02ed-4cf5-bcbe-65d8f746c73d tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 51b65dde-1fef-4daa-9475-7609ac03dbc3] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:49.872394 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7a650361-02ed-4cf5-bcbe-65d8f746c73d tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:49.887170 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7a650361-02ed-4cf5-bcbe-65d8f746c73d tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:49.889687 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7a650361-02ed-4cf5-bcbe-65d8f746c73d tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:49.890470 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7a650361-02ed-4cf5-bcbe-65d8f746c73d tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:49.896191 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7a650361-02ed-4cf5-bcbe-65d8f746c73d tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:49.899046 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7a650361-02ed-4cf5-bcbe-65d8f746c73d tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:49.916543 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:04:50.039655 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-7a650361-02ed-4cf5-bcbe-65d8f746c73d tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:50.056228 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-7a650361-02ed-4cf5-bcbe-65d8f746c73d tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3" status: 200 len: 1302 microversion: 2.1 time: 0.212216 Aug 09 07:04:50.059742 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 194/386] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:49 2022] GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3 => generated 1302 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:50.071463 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f1d34b71-49eb-4f9e-b596-e3cabb2152b5 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:50.072427 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-f1d34b71-49eb-4f9e-b596-e3cabb2152b5 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: f5e9e5b3-58c6-44f2-940a-c72b15dfd8db] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:50.080396 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f1d34b71-49eb-4f9e-b596-e3cabb2152b5 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:50.089791 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f1d34b71-49eb-4f9e-b596-e3cabb2152b5 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:50.091496 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f1d34b71-49eb-4f9e-b596-e3cabb2152b5 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:50.097678 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f1d34b71-49eb-4f9e-b596-e3cabb2152b5 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:50.098199 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f1d34b71-49eb-4f9e-b596-e3cabb2152b5 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:50.098647 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f1d34b71-49eb-4f9e-b596-e3cabb2152b5 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:50.494471 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-f1d34b71-49eb-4f9e-b596-e3cabb2152b5 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:50.510079 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f1d34b71-49eb-4f9e-b596-e3cabb2152b5 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/f5e9e5b3-58c6-44f2-940a-c72b15dfd8db" status: 200 len: 1367 microversion: 2.1 time: 0.437293 Aug 09 07:04:50.511117 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 193/387] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:50 2022] GET /compute/v2.1/servers/f5e9e5b3-58c6-44f2-940a-c72b15dfd8db => generated 1367 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:50.753614 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-3c66a8e5-d37e-4b50-8a1b-1a7a895e0b2b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:50.754624 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-3c66a8e5-d37e-4b50-8a1b-1a7a895e0b2b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:50.763502 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3c66a8e5-d37e-4b50-8a1b-1a7a895e0b2b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:50.764024 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3c66a8e5-d37e-4b50-8a1b-1a7a895e0b2b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:50.764459 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3c66a8e5-d37e-4b50-8a1b-1a7a895e0b2b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:50.765161 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3c66a8e5-d37e-4b50-8a1b-1a7a895e0b2b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:50.765614 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3c66a8e5-d37e-4b50-8a1b-1a7a895e0b2b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:50.766038 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3c66a8e5-d37e-4b50-8a1b-1a7a895e0b2b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:51.078218 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-0e81e51e-aa93-4820-bb24-7b63e6188e6e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:51.078837 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-0e81e51e-aa93-4820-bb24-7b63e6188e6e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 51b65dde-1fef-4daa-9475-7609ac03dbc3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:51.086647 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0e81e51e-aa93-4820-bb24-7b63e6188e6e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:51.087218 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0e81e51e-aa93-4820-bb24-7b63e6188e6e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:51.087703 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0e81e51e-aa93-4820-bb24-7b63e6188e6e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:51.088485 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0e81e51e-aa93-4820-bb24-7b63e6188e6e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:51.096752 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0e81e51e-aa93-4820-bb24-7b63e6188e6e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:51.100374 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0e81e51e-aa93-4820-bb24-7b63e6188e6e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:51.108887 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-3c66a8e5-d37e-4b50-8a1b-1a7a895e0b2b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:51.122554 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-3c66a8e5-d37e-4b50-8a1b-1a7a895e0b2b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:51.125682 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-3c66a8e5-d37e-4b50-8a1b-1a7a895e0b2b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:51.130392 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-3c66a8e5-d37e-4b50-8a1b-1a7a895e0b2b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1721 microversion: 2.20 time: 0.380742 Aug 09 07:04:51.145407 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 195/388] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:04:50 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1721 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:04:51.204467 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-0e81e51e-aa93-4820-bb24-7b63e6188e6e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:51.208688 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:04:51.225107 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-0e81e51e-aa93-4820-bb24-7b63e6188e6e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3" status: 200 len: 1302 microversion: 2.1 time: 0.150621 Aug 09 07:04:51.238846 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 194/389] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:51 2022] GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3 => generated 1302 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:51.280527 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [req-b06fa1d3-8d9b-4e41-8060-644f2da13c9a req-cc986076-c08d-436d-ba70-1686210cb76a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5e9e5b3-58c6-44f2-940a-c72b15dfd8db", "tag": "5e9f9cbf-0095-475f-a9eb-f3868a00ac39"}]} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:04:51.297627 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-b06fa1d3-8d9b-4e41-8060-644f2da13c9a req-cc986076-c08d-436d-ba70-1686210cb76a service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:51.310495 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-b06fa1d3-8d9b-4e41-8060-644f2da13c9a req-cc986076-c08d-436d-ba70-1686210cb76a service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:51.311219 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-b06fa1d3-8d9b-4e41-8060-644f2da13c9a req-cc986076-c08d-436d-ba70-1686210cb76a service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:51.337219 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.compute.server_external_events [req-b06fa1d3-8d9b-4e41-8060-644f2da13c9a req-cc986076-c08d-436d-ba70-1686210cb76a service nova] Creating event network-changed:5e9f9cbf-0095-475f-a9eb-f3868a00ac39 for instance f5e9e5b3-58c6-44f2-940a-c72b15dfd8db on hv-cinder-85251 Aug 09 07:04:51.343859 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [req-b06fa1d3-8d9b-4e41-8060-644f2da13c9a req-cc986076-c08d-436d-ba70-1686210cb76a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067776 Aug 09 07:04:51.343859 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 196/390] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:04:51.533583 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b222cef2-0559-4acb-9612-600062d65466 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:51.534470 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b222cef2-0559-4acb-9612-600062d65466 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: f5e9e5b3-58c6-44f2-940a-c72b15dfd8db] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:51.555565 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b222cef2-0559-4acb-9612-600062d65466 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:51.556329 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b222cef2-0559-4acb-9612-600062d65466 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:51.556817 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b222cef2-0559-4acb-9612-600062d65466 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:51.557583 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b222cef2-0559-4acb-9612-600062d65466 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:51.558043 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b222cef2-0559-4acb-9612-600062d65466 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:51.569636 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b222cef2-0559-4acb-9612-600062d65466 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:52.005238 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b222cef2-0559-4acb-9612-600062d65466 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:52.016944 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b222cef2-0559-4acb-9612-600062d65466 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/f5e9e5b3-58c6-44f2-940a-c72b15dfd8db" status: 200 len: 1367 microversion: 2.1 time: 0.488048 Aug 09 07:04:52.018474 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 195/391] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:51 2022] GET /compute/v2.1/servers/f5e9e5b3-58c6-44f2-940a-c72b15dfd8db => generated 1367 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:52.161424 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-47a6e46b-fb3a-4aa4-b5b4-f37277a7d981 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:52.162141 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-47a6e46b-fb3a-4aa4-b5b4-f37277a7d981 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:52.180268 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-47a6e46b-fb3a-4aa4-b5b4-f37277a7d981 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:52.182267 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-47a6e46b-fb3a-4aa4-b5b4-f37277a7d981 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:52.182913 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-47a6e46b-fb3a-4aa4-b5b4-f37277a7d981 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:52.188159 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-47a6e46b-fb3a-4aa4-b5b4-f37277a7d981 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:52.188731 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-47a6e46b-fb3a-4aa4-b5b4-f37277a7d981 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:52.189186 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-47a6e46b-fb3a-4aa4-b5b4-f37277a7d981 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:52.248040 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-45643ab2-d5bc-481e-924d-a7f68d32615a tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:52.248644 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-45643ab2-d5bc-481e-924d-a7f68d32615a tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 51b65dde-1fef-4daa-9475-7609ac03dbc3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:52.261833 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-45643ab2-d5bc-481e-924d-a7f68d32615a tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:52.262872 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-45643ab2-d5bc-481e-924d-a7f68d32615a tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:52.265693 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-45643ab2-d5bc-481e-924d-a7f68d32615a tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:52.266805 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-45643ab2-d5bc-481e-924d-a7f68d32615a tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:52.268225 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-45643ab2-d5bc-481e-924d-a7f68d32615a tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:52.270915 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-45643ab2-d5bc-481e-924d-a7f68d32615a tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:52.792375 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-45643ab2-d5bc-481e-924d-a7f68d32615a tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:52.796965 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-45643ab2-d5bc-481e-924d-a7f68d32615a tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3" status: 200 len: 1370 microversion: 2.1 time: 0.554187 Aug 09 07:04:52.800770 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 196/392] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:52 2022] GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3 => generated 1370 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:52.811674 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-47a6e46b-fb3a-4aa4-b5b4-f37277a7d981 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:52.823713 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-47a6e46b-fb3a-4aa4-b5b4-f37277a7d981 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:52.826047 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-47a6e46b-fb3a-4aa4-b5b4-f37277a7d981 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:52.827346 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-47a6e46b-fb3a-4aa4-b5b4-f37277a7d981 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1721 microversion: 2.20 time: 0.672858 Aug 09 07:04:52.828184 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 197/393] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:04:52 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1721 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:04:53.039977 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-334d88ef-ba73-443c-a684-77ca200137e3 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:53.040845 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-334d88ef-ba73-443c-a684-77ca200137e3 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: f5e9e5b3-58c6-44f2-940a-c72b15dfd8db] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:53.055286 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-334d88ef-ba73-443c-a684-77ca200137e3 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:53.057975 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-334d88ef-ba73-443c-a684-77ca200137e3 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:53.058763 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-334d88ef-ba73-443c-a684-77ca200137e3 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:53.061951 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-334d88ef-ba73-443c-a684-77ca200137e3 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:53.062650 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-334d88ef-ba73-443c-a684-77ca200137e3 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:53.077430 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-334d88ef-ba73-443c-a684-77ca200137e3 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:53.301779 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-334d88ef-ba73-443c-a684-77ca200137e3 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:53.310716 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-334d88ef-ba73-443c-a684-77ca200137e3 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/f5e9e5b3-58c6-44f2-940a-c72b15dfd8db" status: 200 len: 1367 microversion: 2.1 time: 0.276462 Aug 09 07:04:53.311572 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 197/394] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:53 2022] GET /compute/v2.1/servers/f5e9e5b3-58c6-44f2-940a-c72b15dfd8db => generated 1367 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:53.733198 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [req-98367821-e0e8-449e-8772-c75a813fef9c req-a80f9d3b-c910-4df3-b0e5-6fc5a9cbb407 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51b65dde-1fef-4daa-9475-7609ac03dbc3", "tag": "3d698374-c39d-4ddd-8c8b-02b917b63085"}]} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:04:53.752307 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-98367821-e0e8-449e-8772-c75a813fef9c req-a80f9d3b-c910-4df3-b0e5-6fc5a9cbb407 service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:53.752800 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-98367821-e0e8-449e-8772-c75a813fef9c req-a80f9d3b-c910-4df3-b0e5-6fc5a9cbb407 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:53.760077 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-98367821-e0e8-449e-8772-c75a813fef9c req-a80f9d3b-c910-4df3-b0e5-6fc5a9cbb407 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:53.779725 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.compute.server_external_events [req-98367821-e0e8-449e-8772-c75a813fef9c req-a80f9d3b-c910-4df3-b0e5-6fc5a9cbb407 service nova] Creating event network-changed:3d698374-c39d-4ddd-8c8b-02b917b63085 for instance 51b65dde-1fef-4daa-9475-7609ac03dbc3 on hv-cinder-85251 Aug 09 07:04:53.790640 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [req-98367821-e0e8-449e-8772-c75a813fef9c req-a80f9d3b-c910-4df3-b0e5-6fc5a9cbb407 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060740 Aug 09 07:04:53.796213 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 198/395] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:04:53.824813 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-67aafc81-51d0-4a60-bf90-b2f55001c882 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:53.825685 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-67aafc81-51d0-4a60-bf90-b2f55001c882 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 51b65dde-1fef-4daa-9475-7609ac03dbc3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:53.832050 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-67aafc81-51d0-4a60-bf90-b2f55001c882 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:53.835231 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-67aafc81-51d0-4a60-bf90-b2f55001c882 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:53.835732 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-67aafc81-51d0-4a60-bf90-b2f55001c882 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:53.836463 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-67aafc81-51d0-4a60-bf90-b2f55001c882 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:53.836953 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-67aafc81-51d0-4a60-bf90-b2f55001c882 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:53.837378 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-67aafc81-51d0-4a60-bf90-b2f55001c882 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:53.861460 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-a6308a43-710a-4545-823b-5ffb8701c3e0 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:53.863015 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-a6308a43-710a-4545-823b-5ffb8701c3e0 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:53.871933 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a6308a43-710a-4545-823b-5ffb8701c3e0 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:53.872859 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a6308a43-710a-4545-823b-5ffb8701c3e0 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:53.873461 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a6308a43-710a-4545-823b-5ffb8701c3e0 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:53.874430 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a6308a43-710a-4545-823b-5ffb8701c3e0 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:53.875026 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a6308a43-710a-4545-823b-5ffb8701c3e0 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:53.875617 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a6308a43-710a-4545-823b-5ffb8701c3e0 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:54.118734 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-67aafc81-51d0-4a60-bf90-b2f55001c882 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:54.130699 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-67aafc81-51d0-4a60-bf90-b2f55001c882 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3" status: 200 len: 1370 microversion: 2.1 time: 0.309878 Aug 09 07:04:54.135114 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 198/396] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:53 2022] GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3 => generated 1370 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:54.152094 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-a6308a43-710a-4545-823b-5ffb8701c3e0 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:54.166201 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-a6308a43-710a-4545-823b-5ffb8701c3e0 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:54.169870 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-a6308a43-710a-4545-823b-5ffb8701c3e0 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:54.173433 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-a6308a43-710a-4545-823b-5ffb8701c3e0 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1721 microversion: 2.20 time: 0.318339 Aug 09 07:04:54.174750 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 199/397] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:04:53 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1721 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:04:54.332309 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6f4f656f-667a-43a3-b92a-fc1a4f4b7dda tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:54.332868 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-6f4f656f-667a-43a3-b92a-fc1a4f4b7dda tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: f5e9e5b3-58c6-44f2-940a-c72b15dfd8db] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:54.340307 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6f4f656f-667a-43a3-b92a-fc1a4f4b7dda tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:54.340715 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6f4f656f-667a-43a3-b92a-fc1a4f4b7dda tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:54.341375 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6f4f656f-667a-43a3-b92a-fc1a4f4b7dda tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:54.342297 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6f4f656f-667a-43a3-b92a-fc1a4f4b7dda tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:54.342965 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6f4f656f-667a-43a3-b92a-fc1a4f4b7dda tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:54.344144 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6f4f656f-667a-43a3-b92a-fc1a4f4b7dda tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:54.600859 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6f4f656f-667a-43a3-b92a-fc1a4f4b7dda tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:54.619713 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-6f4f656f-667a-43a3-b92a-fc1a4f4b7dda tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/f5e9e5b3-58c6-44f2-940a-c72b15dfd8db" status: 200 len: 1367 microversion: 2.1 time: 0.290470 Aug 09 07:04:54.620681 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 199/398] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:54 2022] GET /compute/v2.1/servers/f5e9e5b3-58c6-44f2-940a-c72b15dfd8db => generated 1367 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:55.195444 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-7850b5e3-bcbf-4703-b42a-3d18340f1abc tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:55.200141 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-40116df8-89c2-436a-b225-280ae38f630f tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:55.201334 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-40116df8-89c2-436a-b225-280ae38f630f tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:55.208667 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-7850b5e3-bcbf-4703-b42a-3d18340f1abc tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 51b65dde-1fef-4daa-9475-7609ac03dbc3] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:55.212882 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=4 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:04:55.216256 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-40116df8-89c2-436a-b225-280ae38f630f tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:55.217981 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-40116df8-89c2-436a-b225-280ae38f630f tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:55.219366 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-40116df8-89c2-436a-b225-280ae38f630f tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:55.220582 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-40116df8-89c2-436a-b225-280ae38f630f tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:55.221352 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-40116df8-89c2-436a-b225-280ae38f630f tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:55.222343 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-40116df8-89c2-436a-b225-280ae38f630f tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:55.256127 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7850b5e3-bcbf-4703-b42a-3d18340f1abc tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:55.258024 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7850b5e3-bcbf-4703-b42a-3d18340f1abc tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:55.259273 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7850b5e3-bcbf-4703-b42a-3d18340f1abc tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:55.264779 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7850b5e3-bcbf-4703-b42a-3d18340f1abc tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:55.270858 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7850b5e3-bcbf-4703-b42a-3d18340f1abc tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:55.277379 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7850b5e3-bcbf-4703-b42a-3d18340f1abc tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:55.586585 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-7850b5e3-bcbf-4703-b42a-3d18340f1abc tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:55.597215 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-7850b5e3-bcbf-4703-b42a-3d18340f1abc tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3" status: 200 len: 1370 microversion: 2.1 time: 0.416300 Aug 09 07:04:55.603712 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 200/399] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:55 2022] GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3 => generated 1370 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:55.657328 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-88dfa785-4cb3-475a-a62d-13c51833b9f0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:55.658289 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-88dfa785-4cb3-475a-a62d-13c51833b9f0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: f5e9e5b3-58c6-44f2-940a-c72b15dfd8db] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:55.666172 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-88dfa785-4cb3-475a-a62d-13c51833b9f0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:55.666667 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-88dfa785-4cb3-475a-a62d-13c51833b9f0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:55.667103 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-88dfa785-4cb3-475a-a62d-13c51833b9f0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:55.668489 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-88dfa785-4cb3-475a-a62d-13c51833b9f0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:55.669121 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-88dfa785-4cb3-475a-a62d-13c51833b9f0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:55.670329 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-88dfa785-4cb3-475a-a62d-13c51833b9f0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:55.937709 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-40116df8-89c2-436a-b225-280ae38f630f tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:55.956271 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-40116df8-89c2-436a-b225-280ae38f630f tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:55.958958 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-40116df8-89c2-436a-b225-280ae38f630f tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:55.974179 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-40116df8-89c2-436a-b225-280ae38f630f tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1742 microversion: 2.20 time: 0.778600 Aug 09 07:04:55.979195 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 200/400] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:04:55 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1742 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 07:04:56.021960 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e99ad0a8-e4a9-49f8-b1d5-c16819b8c0c5 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:04:56.050260 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e99ad0a8-e4a9-49f8-b1d5-c16819b8c0c5 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:56.050776 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e99ad0a8-e4a9-49f8-b1d5-c16819b8c0c5 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:56.052628 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e99ad0a8-e4a9-49f8-b1d5-c16819b8c0c5 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:56.065044 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-88dfa785-4cb3-475a-a62d-13c51833b9f0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:56.082632 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-88dfa785-4cb3-475a-a62d-13c51833b9f0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/f5e9e5b3-58c6-44f2-940a-c72b15dfd8db" status: 200 len: 1367 microversion: 2.1 time: 0.441289 Aug 09 07:04:56.106254 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 201/401] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:55 2022] GET /compute/v2.1/servers/f5e9e5b3-58c6-44f2-940a-c72b15dfd8db => generated 1367 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:56.154976 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-e99ad0a8-e4a9-49f8-b1d5-c16819b8c0c5 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Going to try to stop instance {{(pid=117859) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 09 07:04:56.226916 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-e99ad0a8-e4a9-49f8-b1d5-c16819b8c0c5 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "POST /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46/action" status: 202 len: 0 microversion: 2.1 time: 0.245994 Aug 09 07:04:56.230170 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 201/402] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 9 07:04:55 2022] POST /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 07:04:56.238743 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-f19443c5-6d36-42e4-b8a9-0876305cbaab tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:56.239371 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-f19443c5-6d36-42e4-b8a9-0876305cbaab tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:56.247982 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f19443c5-6d36-42e4-b8a9-0876305cbaab tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:56.248481 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f19443c5-6d36-42e4-b8a9-0876305cbaab tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:56.248917 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f19443c5-6d36-42e4-b8a9-0876305cbaab tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:56.249795 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f19443c5-6d36-42e4-b8a9-0876305cbaab tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:56.250424 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f19443c5-6d36-42e4-b8a9-0876305cbaab tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:56.250854 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f19443c5-6d36-42e4-b8a9-0876305cbaab tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:56.280299 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_cell0:SELECT=2 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:04:56.461601 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-f19443c5-6d36-42e4-b8a9-0876305cbaab tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:56.478973 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-f19443c5-6d36-42e4-b8a9-0876305cbaab tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1724 microversion: 2.1 time: 0.243933 Aug 09 07:04:56.484768 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 202/403] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:56 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1724 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:56.636372 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-96d141e7-47c1-4a20-82f1-37ed4f7e84a8 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:56.637796 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-96d141e7-47c1-4a20-82f1-37ed4f7e84a8 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 51b65dde-1fef-4daa-9475-7609ac03dbc3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:56.695562 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-96d141e7-47c1-4a20-82f1-37ed4f7e84a8 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:56.699588 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-96d141e7-47c1-4a20-82f1-37ed4f7e84a8 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:56.700094 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-96d141e7-47c1-4a20-82f1-37ed4f7e84a8 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:56.713896 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-96d141e7-47c1-4a20-82f1-37ed4f7e84a8 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:56.717716 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-96d141e7-47c1-4a20-82f1-37ed4f7e84a8 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:56.730179 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-96d141e7-47c1-4a20-82f1-37ed4f7e84a8 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:56.947276 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-96d141e7-47c1-4a20-82f1-37ed4f7e84a8 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:56.963243 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-96d141e7-47c1-4a20-82f1-37ed4f7e84a8 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3" status: 200 len: 1370 microversion: 2.1 time: 0.339078 Aug 09 07:04:56.963977 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 202/404] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:56 2022] GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3 => generated 1370 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:57.002195 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-9c2a9839-e951-4240-b5db-8d36c3d37489 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:57.003017 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-9c2a9839-e951-4240-b5db-8d36c3d37489 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:57.010115 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9c2a9839-e951-4240-b5db-8d36c3d37489 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:57.020541 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9c2a9839-e951-4240-b5db-8d36c3d37489 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:57.021204 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9c2a9839-e951-4240-b5db-8d36c3d37489 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:57.022724 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9c2a9839-e951-4240-b5db-8d36c3d37489 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:57.023641 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9c2a9839-e951-4240-b5db-8d36c3d37489 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:57.024510 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9c2a9839-e951-4240-b5db-8d36c3d37489 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:57.106380 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a442d358-19b8-47ca-b618-1be284277416 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:57.107006 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-a442d358-19b8-47ca-b618-1be284277416 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: f5e9e5b3-58c6-44f2-940a-c72b15dfd8db] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:57.115324 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a442d358-19b8-47ca-b618-1be284277416 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:57.116395 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a442d358-19b8-47ca-b618-1be284277416 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:57.117564 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a442d358-19b8-47ca-b618-1be284277416 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:57.118567 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a442d358-19b8-47ca-b618-1be284277416 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:57.119241 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a442d358-19b8-47ca-b618-1be284277416 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:57.120282 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a442d358-19b8-47ca-b618-1be284277416 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:57.253760 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=2 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:04:57.297335 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=10 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:04:57.347404 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-9c2a9839-e951-4240-b5db-8d36c3d37489 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:57.368924 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-9c2a9839-e951-4240-b5db-8d36c3d37489 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:57.371730 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-9c2a9839-e951-4240-b5db-8d36c3d37489 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:57.383470 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-9c2a9839-e951-4240-b5db-8d36c3d37489 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1742 microversion: 2.20 time: 0.378013 Aug 09 07:04:57.384302 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 203/405] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:04:56 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1742 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:04:57.435144 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-a442d358-19b8-47ca-b618-1be284277416 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:57.446675 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-a442d358-19b8-47ca-b618-1be284277416 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/f5e9e5b3-58c6-44f2-940a-c72b15dfd8db" status: 200 len: 1367 microversion: 2.1 time: 0.344478 Aug 09 07:04:57.456234 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 203/406] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:57 2022] GET /compute/v2.1/servers/f5e9e5b3-58c6-44f2-940a-c72b15dfd8db => generated 1367 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:57.510851 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-c99b7b61-8d03-4206-b1af-0e1c83424219 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:57.515045 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-c99b7b61-8d03-4206-b1af-0e1c83424219 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:57.526622 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c99b7b61-8d03-4206-b1af-0e1c83424219 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:57.527360 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c99b7b61-8d03-4206-b1af-0e1c83424219 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:57.528273 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c99b7b61-8d03-4206-b1af-0e1c83424219 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:57.529437 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c99b7b61-8d03-4206-b1af-0e1c83424219 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:57.530294 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c99b7b61-8d03-4206-b1af-0e1c83424219 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:57.530918 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c99b7b61-8d03-4206-b1af-0e1c83424219 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:57.537310 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_cell0:SELECT=14 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:04:57.715723 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-c99b7b61-8d03-4206-b1af-0e1c83424219 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:57.728595 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-c99b7b61-8d03-4206-b1af-0e1c83424219 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1724 microversion: 2.1 time: 0.225703 Aug 09 07:04:57.729277 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 204/407] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:57 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1724 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:57.950879 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-ea32ee42-88c1-41cd-abd9-b73c0773a842 req-2cfc688e-c153-4230-8f2f-592a7aa2369d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2236b6b2-39b4-4b81-bb86-006774babc2e", "name": "network-vif-plugged", "status": "completed", "tag": "ada64d06-0764-4487-9425-780bad419035"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:04:57.971067 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-ea32ee42-88c1-41cd-abd9-b73c0773a842 req-2cfc688e-c153-4230-8f2f-592a7aa2369d service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:57.976585 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-ea32ee42-88c1-41cd-abd9-b73c0773a842 req-2cfc688e-c153-4230-8f2f-592a7aa2369d service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:57.977376 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-ea32ee42-88c1-41cd-abd9-b73c0773a842 req-2cfc688e-c153-4230-8f2f-592a7aa2369d service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:57.988902 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-9e159f2e-bed0-4f11-bf72-b3d02fdce4b1 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:57.992528 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-9e159f2e-bed0-4f11-bf72-b3d02fdce4b1 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 51b65dde-1fef-4daa-9475-7609ac03dbc3] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:58.007094 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9e159f2e-bed0-4f11-bf72-b3d02fdce4b1 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:58.007935 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9e159f2e-bed0-4f11-bf72-b3d02fdce4b1 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:58.008854 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9e159f2e-bed0-4f11-bf72-b3d02fdce4b1 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:58.009775 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9e159f2e-bed0-4f11-bf72-b3d02fdce4b1 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:58.010488 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9e159f2e-bed0-4f11-bf72-b3d02fdce4b1 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:58.011087 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9e159f2e-bed0-4f11-bf72-b3d02fdce4b1 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:58.017769 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-ea32ee42-88c1-41cd-abd9-b73c0773a842 req-2cfc688e-c153-4230-8f2f-592a7aa2369d service nova] Creating event network-vif-plugged:ada64d06-0764-4487-9425-780bad419035 for instance 2236b6b2-39b4-4b81-bb86-006774babc2e on hv-cinder-85251 Aug 09 07:04:58.034276 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-ea32ee42-88c1-41cd-abd9-b73c0773a842 req-2cfc688e-c153-4230-8f2f-592a7aa2369d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086974 Aug 09 07:04:58.035462 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 204/408] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:04:58.220788 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-9e159f2e-bed0-4f11-bf72-b3d02fdce4b1 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:58.230732 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-9e159f2e-bed0-4f11-bf72-b3d02fdce4b1 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3" status: 200 len: 1370 microversion: 2.1 time: 0.245981 Aug 09 07:04:58.232228 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 205/409] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:57 2022] GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3 => generated 1370 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:04:58.409862 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-baa6007c-7902-49d9-80e4-c5aed0d60980 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:58.410555 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-baa6007c-7902-49d9-80e4-c5aed0d60980 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:58.430812 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-baa6007c-7902-49d9-80e4-c5aed0d60980 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:58.431317 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-baa6007c-7902-49d9-80e4-c5aed0d60980 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:58.431785 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-baa6007c-7902-49d9-80e4-c5aed0d60980 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:58.432503 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-baa6007c-7902-49d9-80e4-c5aed0d60980 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:58.437152 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-baa6007c-7902-49d9-80e4-c5aed0d60980 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:58.437665 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-baa6007c-7902-49d9-80e4-c5aed0d60980 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:58.470720 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-6484df8d-252e-4012-8922-0cb9651c81a7 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:58.472596 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-6484df8d-252e-4012-8922-0cb9651c81a7 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: f5e9e5b3-58c6-44f2-940a-c72b15dfd8db] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:58.488477 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6484df8d-252e-4012-8922-0cb9651c81a7 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:58.489378 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6484df8d-252e-4012-8922-0cb9651c81a7 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:58.494420 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6484df8d-252e-4012-8922-0cb9651c81a7 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:58.495325 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6484df8d-252e-4012-8922-0cb9651c81a7 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:58.495920 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6484df8d-252e-4012-8922-0cb9651c81a7 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:58.496426 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6484df8d-252e-4012-8922-0cb9651c81a7 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:58.706862 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-baa6007c-7902-49d9-80e4-c5aed0d60980 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:58.717890 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-baa6007c-7902-49d9-80e4-c5aed0d60980 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:58.727109 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-baa6007c-7902-49d9-80e4-c5aed0d60980 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:58.728769 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-baa6007c-7902-49d9-80e4-c5aed0d60980 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1737 microversion: 2.20 time: 0.324271 Aug 09 07:04:58.730715 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 205/410] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:04:58 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1737 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:04:58.750244 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-13923764-86ae-41b0-b75e-76037e1e23cf tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:58.751138 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-13923764-86ae-41b0-b75e-76037e1e23cf tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:58.760693 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-13923764-86ae-41b0-b75e-76037e1e23cf tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:58.761685 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-13923764-86ae-41b0-b75e-76037e1e23cf tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:58.762360 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-13923764-86ae-41b0-b75e-76037e1e23cf tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:58.763679 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-13923764-86ae-41b0-b75e-76037e1e23cf tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:58.764399 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-13923764-86ae-41b0-b75e-76037e1e23cf tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:58.766131 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-13923764-86ae-41b0-b75e-76037e1e23cf tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:58.798151 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-6484df8d-252e-4012-8922-0cb9651c81a7 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:58.807498 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-6484df8d-252e-4012-8922-0cb9651c81a7 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/f5e9e5b3-58c6-44f2-940a-c72b15dfd8db" status: 200 len: 1367 microversion: 2.1 time: 0.342700 Aug 09 07:04:58.808632 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 206/411] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:58 2022] GET /compute/v2.1/servers/f5e9e5b3-58c6-44f2-940a-c72b15dfd8db => generated 1367 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:58.944059 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-13923764-86ae-41b0-b75e-76037e1e23cf tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:58.954500 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-13923764-86ae-41b0-b75e-76037e1e23cf tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1724 microversion: 2.1 time: 0.208022 Aug 09 07:04:58.956000 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 206/412] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:58 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1724 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:04:59.257301 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-cd7e706b-78b2-4037-aac5-33fbf12189bb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:59.257915 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-cd7e706b-78b2-4037-aac5-33fbf12189bb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 51b65dde-1fef-4daa-9475-7609ac03dbc3] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:59.265811 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cd7e706b-78b2-4037-aac5-33fbf12189bb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:59.266286 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cd7e706b-78b2-4037-aac5-33fbf12189bb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:59.266925 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cd7e706b-78b2-4037-aac5-33fbf12189bb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:59.267826 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cd7e706b-78b2-4037-aac5-33fbf12189bb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:59.268479 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cd7e706b-78b2-4037-aac5-33fbf12189bb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:59.269053 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cd7e706b-78b2-4037-aac5-33fbf12189bb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:59.756049 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-60ebcb36-f389-4822-ac6b-7bb7defbce71 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:59.757355 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-60ebcb36-f389-4822-ac6b-7bb7defbce71 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:59.765816 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-60ebcb36-f389-4822-ac6b-7bb7defbce71 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:59.766533 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-60ebcb36-f389-4822-ac6b-7bb7defbce71 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:59.767199 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-60ebcb36-f389-4822-ac6b-7bb7defbce71 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:59.769045 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-60ebcb36-f389-4822-ac6b-7bb7defbce71 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:59.769834 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-60ebcb36-f389-4822-ac6b-7bb7defbce71 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:59.770425 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-60ebcb36-f389-4822-ac6b-7bb7defbce71 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:59.837985 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-cd7e706b-78b2-4037-aac5-33fbf12189bb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:04:59.851082 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-cd7e706b-78b2-4037-aac5-33fbf12189bb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3" status: 200 len: 1370 microversion: 2.1 time: 0.598484 Aug 09 07:04:59.858281 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 207/413] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:59 2022] GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3 => generated 1370 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:04:59.880530 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-a3d0ed61-1803-4e8f-9694-8c37481eee29 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:04:59.882149 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-a3d0ed61-1803-4e8f-9694-8c37481eee29 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: f5e9e5b3-58c6-44f2-940a-c72b15dfd8db] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:04:59.895066 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a3d0ed61-1803-4e8f-9694-8c37481eee29 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:59.897905 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a3d0ed61-1803-4e8f-9694-8c37481eee29 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:59.902910 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a3d0ed61-1803-4e8f-9694-8c37481eee29 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:04:59.904041 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a3d0ed61-1803-4e8f-9694-8c37481eee29 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:04:59.904680 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a3d0ed61-1803-4e8f-9694-8c37481eee29 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:04:59.905384 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a3d0ed61-1803-4e8f-9694-8c37481eee29 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:00.122189 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-60ebcb36-f389-4822-ac6b-7bb7defbce71 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:00.146326 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-60ebcb36-f389-4822-ac6b-7bb7defbce71 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:00.158163 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-60ebcb36-f389-4822-ac6b-7bb7defbce71 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:00.159872 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-60ebcb36-f389-4822-ac6b-7bb7defbce71 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1737 microversion: 2.20 time: 0.409214 Aug 09 07:05:00.162185 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 207/414] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:04:59 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1737 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:05:00.187767 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-8067b7d6-a000-4fcd-95ba-94073bd4bc2f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:00.188877 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-8067b7d6-a000-4fcd-95ba-94073bd4bc2f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:00.214086 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8067b7d6-a000-4fcd-95ba-94073bd4bc2f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:00.216904 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8067b7d6-a000-4fcd-95ba-94073bd4bc2f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:00.219973 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8067b7d6-a000-4fcd-95ba-94073bd4bc2f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:00.220774 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8067b7d6-a000-4fcd-95ba-94073bd4bc2f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:00.224527 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8067b7d6-a000-4fcd-95ba-94073bd4bc2f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:00.228035 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8067b7d6-a000-4fcd-95ba-94073bd4bc2f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:00.249590 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-a3d0ed61-1803-4e8f-9694-8c37481eee29 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:00.268223 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-a3d0ed61-1803-4e8f-9694-8c37481eee29 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/f5e9e5b3-58c6-44f2-940a-c72b15dfd8db" status: 200 len: 1367 microversion: 2.1 time: 0.401295 Aug 09 07:05:00.268850 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 208/415] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:04:59 2022] GET /compute/v2.1/servers/f5e9e5b3-58c6-44f2-940a-c72b15dfd8db => generated 1367 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:05:00.283426 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [req-6a136bd7-e667-4d37-abc1-ab367430abbf req-042f3c61-05de-4eee-afb4-92e56018846e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5e9e5b3-58c6-44f2-940a-c72b15dfd8db", "name": "network-vif-plugged", "status": "completed", "tag": "5e9f9cbf-0095-475f-a9eb-f3868a00ac39"}]} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:05:00.312113 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-6a136bd7-e667-4d37-abc1-ab367430abbf req-042f3c61-05de-4eee-afb4-92e56018846e service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:00.312788 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-6a136bd7-e667-4d37-abc1-ab367430abbf req-042f3c61-05de-4eee-afb4-92e56018846e service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:00.313384 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-6a136bd7-e667-4d37-abc1-ab367430abbf req-042f3c61-05de-4eee-afb4-92e56018846e service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:00.329861 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.compute.server_external_events [req-6a136bd7-e667-4d37-abc1-ab367430abbf req-042f3c61-05de-4eee-afb4-92e56018846e service nova] Creating event network-vif-plugged:5e9f9cbf-0095-475f-a9eb-f3868a00ac39 for instance f5e9e5b3-58c6-44f2-940a-c72b15dfd8db on hv-cinder-85251 Aug 09 07:05:00.337334 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [req-6a136bd7-e667-4d37-abc1-ab367430abbf req-042f3c61-05de-4eee-afb4-92e56018846e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067275 Aug 09 07:05:00.338585 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 209/416] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:05:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:05:00.626989 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8067b7d6-a000-4fcd-95ba-94073bd4bc2f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:00.640240 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-8067b7d6-a000-4fcd-95ba-94073bd4bc2f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1724 microversion: 2.1 time: 0.476089 Aug 09 07:05:00.645016 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 208/417] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:05:00 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1724 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:05:00.882922 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-00b1631c-1f88-4aa1-9567-d9cf054054de tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:00.884467 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-00b1631c-1f88-4aa1-9567-d9cf054054de tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 51b65dde-1fef-4daa-9475-7609ac03dbc3] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:00.911522 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-00b1631c-1f88-4aa1-9567-d9cf054054de tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:00.912184 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-00b1631c-1f88-4aa1-9567-d9cf054054de tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:00.915482 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-00b1631c-1f88-4aa1-9567-d9cf054054de tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:00.916344 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-00b1631c-1f88-4aa1-9567-d9cf054054de tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:00.916834 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-00b1631c-1f88-4aa1-9567-d9cf054054de tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:00.917283 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-00b1631c-1f88-4aa1-9567-d9cf054054de tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:01.152914 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-00b1631c-1f88-4aa1-9567-d9cf054054de tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:01.185889 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-00b1631c-1f88-4aa1-9567-d9cf054054de tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3" status: 200 len: 1370 microversion: 2.1 time: 0.308378 Aug 09 07:05:01.186806 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 210/418] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:05:00 2022] GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3 => generated 1370 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:05:01.203787 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-86f11645-a9b2-48ec-9da0-26b424908772 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:01.204494 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-86f11645-a9b2-48ec-9da0-26b424908772 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:01.215428 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-86f11645-a9b2-48ec-9da0-26b424908772 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:01.220924 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-86f11645-a9b2-48ec-9da0-26b424908772 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:01.221567 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-86f11645-a9b2-48ec-9da0-26b424908772 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:01.222503 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-86f11645-a9b2-48ec-9da0-26b424908772 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:01.227443 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-86f11645-a9b2-48ec-9da0-26b424908772 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:01.231540 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-86f11645-a9b2-48ec-9da0-26b424908772 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:01.298352 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-f4dc2166-5dc5-4585-9c26-90f1208342d6 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:01.299494 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-f4dc2166-5dc5-4585-9c26-90f1208342d6 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: f5e9e5b3-58c6-44f2-940a-c72b15dfd8db] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:01.312451 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f4dc2166-5dc5-4585-9c26-90f1208342d6 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:01.313041 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f4dc2166-5dc5-4585-9c26-90f1208342d6 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:01.313408 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f4dc2166-5dc5-4585-9c26-90f1208342d6 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:01.314840 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f4dc2166-5dc5-4585-9c26-90f1208342d6 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:01.315228 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f4dc2166-5dc5-4585-9c26-90f1208342d6 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:01.315750 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f4dc2166-5dc5-4585-9c26-90f1208342d6 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:01.566252 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-86f11645-a9b2-48ec-9da0-26b424908772 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:01.590318 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-86f11645-a9b2-48ec-9da0-26b424908772 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:01.592182 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-86f11645-a9b2-48ec-9da0-26b424908772 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:01.594166 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-86f11645-a9b2-48ec-9da0-26b424908772 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1737 microversion: 2.20 time: 0.394801 Aug 09 07:05:01.596428 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 209/419] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:05:01 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1737 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:05:01.641592 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-f4dc2166-5dc5-4585-9c26-90f1208342d6 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:01.653266 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-f4dc2166-5dc5-4585-9c26-90f1208342d6 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/f5e9e5b3-58c6-44f2-940a-c72b15dfd8db" status: 200 len: 1367 microversion: 2.1 time: 0.359877 Aug 09 07:05:01.660822 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 211/420] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:05:01 2022] GET /compute/v2.1/servers/f5e9e5b3-58c6-44f2-940a-c72b15dfd8db => generated 1367 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:05:01.677402 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b5a3b835-9014-4bdb-84d4-3c934936309d tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:01.678505 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b5a3b835-9014-4bdb-84d4-3c934936309d tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:01.686197 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b5a3b835-9014-4bdb-84d4-3c934936309d tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:01.686926 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b5a3b835-9014-4bdb-84d4-3c934936309d tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:01.687725 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b5a3b835-9014-4bdb-84d4-3c934936309d tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:01.688707 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b5a3b835-9014-4bdb-84d4-3c934936309d tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:01.689387 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b5a3b835-9014-4bdb-84d4-3c934936309d tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:01.690546 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b5a3b835-9014-4bdb-84d4-3c934936309d tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:02.039015 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b5a3b835-9014-4bdb-84d4-3c934936309d tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:02.071002 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b5a3b835-9014-4bdb-84d4-3c934936309d tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1724 microversion: 2.1 time: 0.397201 Aug 09 07:05:02.073160 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 210/421] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:05:01 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1724 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:05:02.207983 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-ea82c617-db38-4af2-980c-c24642d8f38d tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:02.209823 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-ea82c617-db38-4af2-980c-c24642d8f38d tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 51b65dde-1fef-4daa-9475-7609ac03dbc3] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:02.226180 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ea82c617-db38-4af2-980c-c24642d8f38d tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:02.227966 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ea82c617-db38-4af2-980c-c24642d8f38d tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:02.228657 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ea82c617-db38-4af2-980c-c24642d8f38d tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:02.236240 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ea82c617-db38-4af2-980c-c24642d8f38d tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:02.237792 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ea82c617-db38-4af2-980c-c24642d8f38d tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:02.238466 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ea82c617-db38-4af2-980c-c24642d8f38d tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:02.548213 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-ea82c617-db38-4af2-980c-c24642d8f38d tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:02.551676 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_cell1:SELECT=100 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:05:02.571309 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-ea82c617-db38-4af2-980c-c24642d8f38d tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3" status: 200 len: 1370 microversion: 2.1 time: 0.367652 Aug 09 07:05:02.574220 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 212/422] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:05:02 2022] GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3 => generated 1370 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:05:02.592652 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-3330750c-a96e-41ed-825e-b7c4bd774254 req-39e007cc-bc9d-4fd4-97ae-6ea15575ef06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51b65dde-1fef-4daa-9475-7609ac03dbc3", "name": "network-vif-plugged", "status": "completed", "tag": "3d698374-c39d-4ddd-8c8b-02b917b63085"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:05:02.619909 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-bb003c80-947d-4888-b140-8df21b8fbf07 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:02.620216 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-3330750c-a96e-41ed-825e-b7c4bd774254 req-39e007cc-bc9d-4fd4-97ae-6ea15575ef06 service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:02.620709 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-3330750c-a96e-41ed-825e-b7c4bd774254 req-39e007cc-bc9d-4fd4-97ae-6ea15575ef06 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:02.621270 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-3330750c-a96e-41ed-825e-b7c4bd774254 req-39e007cc-bc9d-4fd4-97ae-6ea15575ef06 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:02.628591 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-bb003c80-947d-4888-b140-8df21b8fbf07 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:02.634029 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:05:02.639944 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-bb003c80-947d-4888-b140-8df21b8fbf07 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:02.642783 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-bb003c80-947d-4888-b140-8df21b8fbf07 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:02.643389 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-bb003c80-947d-4888-b140-8df21b8fbf07 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:02.645025 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-bb003c80-947d-4888-b140-8df21b8fbf07 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:02.649021 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-bb003c80-947d-4888-b140-8df21b8fbf07 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:02.649648 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-bb003c80-947d-4888-b140-8df21b8fbf07 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:02.658790 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-3330750c-a96e-41ed-825e-b7c4bd774254 req-39e007cc-bc9d-4fd4-97ae-6ea15575ef06 service nova] Creating event network-vif-plugged:3d698374-c39d-4ddd-8c8b-02b917b63085 for instance 51b65dde-1fef-4daa-9475-7609ac03dbc3 on hv-cinder-85251 Aug 09 07:05:02.679870 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-3330750c-a96e-41ed-825e-b7c4bd774254 req-39e007cc-bc9d-4fd4-97ae-6ea15575ef06 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088314 Aug 09 07:05:02.680529 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 211/423] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:05:02.697102 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-01a3133d-24ae-41e1-a42c-e1d4f850f62b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:02.699577 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-01a3133d-24ae-41e1-a42c-e1d4f850f62b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: f5e9e5b3-58c6-44f2-940a-c72b15dfd8db] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:02.719273 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-01a3133d-24ae-41e1-a42c-e1d4f850f62b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:02.719884 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-01a3133d-24ae-41e1-a42c-e1d4f850f62b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:02.720331 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-01a3133d-24ae-41e1-a42c-e1d4f850f62b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:02.724465 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-01a3133d-24ae-41e1-a42c-e1d4f850f62b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:02.726574 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-01a3133d-24ae-41e1-a42c-e1d4f850f62b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:02.727046 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-01a3133d-24ae-41e1-a42c-e1d4f850f62b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:03.188351 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-bb003c80-947d-4888-b140-8df21b8fbf07 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:03.196715 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-01a3133d-24ae-41e1-a42c-e1d4f850f62b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:03.214927 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-bb003c80-947d-4888-b140-8df21b8fbf07 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:03.216490 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-bb003c80-947d-4888-b140-8df21b8fbf07 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:03.217722 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-bb003c80-947d-4888-b140-8df21b8fbf07 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1737 microversion: 2.20 time: 0.602843 Aug 09 07:05:03.228974 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 213/424] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:05:02 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1737 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:05:03.253712 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-e4ec5303-b76f-4079-8c67-032fbfbb5255 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:03.262594 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-e4ec5303-b76f-4079-8c67-032fbfbb5255 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:03.264878 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-01a3133d-24ae-41e1-a42c-e1d4f850f62b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/f5e9e5b3-58c6-44f2-940a-c72b15dfd8db" status: 200 len: 1557 microversion: 2.1 time: 0.583117 Aug 09 07:05:03.266182 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 212/425] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:05:02 2022] GET /compute/v2.1/servers/f5e9e5b3-58c6-44f2-940a-c72b15dfd8db => generated 1557 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:05:03.287099 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e4ec5303-b76f-4079-8c67-032fbfbb5255 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:03.289688 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e4ec5303-b76f-4079-8c67-032fbfbb5255 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:03.290416 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e4ec5303-b76f-4079-8c67-032fbfbb5255 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:03.291317 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e4ec5303-b76f-4079-8c67-032fbfbb5255 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:03.295434 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e4ec5303-b76f-4079-8c67-032fbfbb5255 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:03.296153 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e4ec5303-b76f-4079-8c67-032fbfbb5255 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:03.303249 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4e0c4eea-293d-4144-b342-5696d03efb64 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:03.308208 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4e0c4eea-293d-4144-b342-5696d03efb64 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: f5e9e5b3-58c6-44f2-940a-c72b15dfd8db] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:03.327592 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4e0c4eea-293d-4144-b342-5696d03efb64 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:03.328281 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4e0c4eea-293d-4144-b342-5696d03efb64 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:03.328829 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4e0c4eea-293d-4144-b342-5696d03efb64 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:03.330217 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4e0c4eea-293d-4144-b342-5696d03efb64 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:03.331230 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4e0c4eea-293d-4144-b342-5696d03efb64 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:03.335821 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4e0c4eea-293d-4144-b342-5696d03efb64 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:03.493948 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4e0c4eea-293d-4144-b342-5696d03efb64 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/f5e9e5b3-58c6-44f2-940a-c72b15dfd8db/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.199181 Aug 09 07:05:03.494962 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 213/426] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Aug 9 07:05:03 2022] GET /compute/v2.1/servers/f5e9e5b3-58c6-44f2-940a-c72b15dfd8db/os-interface => generated 284 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 07:05:03.551955 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-e4ec5303-b76f-4079-8c67-032fbfbb5255 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:03.561139 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-e4ec5303-b76f-4079-8c67-032fbfbb5255 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1724 microversion: 2.1 time: 0.330783 Aug 09 07:05:03.561933 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 214/427] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:05:03 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1724 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:05:03.595308 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d7ee8906-fde8-48ce-830c-75eb566ef7b1 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:03.596863 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-d7ee8906-fde8-48ce-830c-75eb566ef7b1 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 51b65dde-1fef-4daa-9475-7609ac03dbc3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:03.609171 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d7ee8906-fde8-48ce-830c-75eb566ef7b1 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:03.610458 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d7ee8906-fde8-48ce-830c-75eb566ef7b1 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:03.611251 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d7ee8906-fde8-48ce-830c-75eb566ef7b1 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:03.614149 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d7ee8906-fde8-48ce-830c-75eb566ef7b1 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:03.614900 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d7ee8906-fde8-48ce-830c-75eb566ef7b1 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:03.615728 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d7ee8906-fde8-48ce-830c-75eb566ef7b1 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:03.939194 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d7ee8906-fde8-48ce-830c-75eb566ef7b1 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:03.958511 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-d7ee8906-fde8-48ce-830c-75eb566ef7b1 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3" status: 200 len: 1370 microversion: 2.1 time: 0.367516 Aug 09 07:05:03.962926 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 214/428] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:05:03 2022] GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3 => generated 1370 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:05:04.265992 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-4f496982-ed6c-40f2-a7cb-81364dcfe88e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:04.266555 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-4f496982-ed6c-40f2-a7cb-81364dcfe88e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:04.281270 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4f496982-ed6c-40f2-a7cb-81364dcfe88e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:04.281773 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4f496982-ed6c-40f2-a7cb-81364dcfe88e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:04.282212 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4f496982-ed6c-40f2-a7cb-81364dcfe88e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:04.282920 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4f496982-ed6c-40f2-a7cb-81364dcfe88e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:04.283374 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4f496982-ed6c-40f2-a7cb-81364dcfe88e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:04.292150 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4f496982-ed6c-40f2-a7cb-81364dcfe88e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:04.583948 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c1f8df31-aaea-4004-bb89-f6bbfe25dd4f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:04.585557 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c1f8df31-aaea-4004-bb89-f6bbfe25dd4f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:04.592717 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c1f8df31-aaea-4004-bb89-f6bbfe25dd4f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:04.593204 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c1f8df31-aaea-4004-bb89-f6bbfe25dd4f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:04.593637 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c1f8df31-aaea-4004-bb89-f6bbfe25dd4f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:04.594340 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c1f8df31-aaea-4004-bb89-f6bbfe25dd4f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:04.594794 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c1f8df31-aaea-4004-bb89-f6bbfe25dd4f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:04.595216 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c1f8df31-aaea-4004-bb89-f6bbfe25dd4f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:04.609934 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-4f496982-ed6c-40f2-a7cb-81364dcfe88e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:04.626008 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-4f496982-ed6c-40f2-a7cb-81364dcfe88e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:04.627853 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-4f496982-ed6c-40f2-a7cb-81364dcfe88e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:04.634574 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-4f496982-ed6c-40f2-a7cb-81364dcfe88e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1737 microversion: 2.20 time: 0.375114 Aug 09 07:05:04.635406 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 215/429] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:05:04 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1737 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:05:04.907375 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c1f8df31-aaea-4004-bb89-f6bbfe25dd4f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:04.924048 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c1f8df31-aaea-4004-bb89-f6bbfe25dd4f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1724 microversion: 2.1 time: 0.343819 Aug 09 07:05:04.926828 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 215/430] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:05:04 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1724 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:05:04.983115 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-d02a8099-ca55-4a65-a608-74b540955095 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:04.984850 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-d02a8099-ca55-4a65-a608-74b540955095 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 51b65dde-1fef-4daa-9475-7609ac03dbc3] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:05.001858 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d02a8099-ca55-4a65-a608-74b540955095 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:05.003130 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d02a8099-ca55-4a65-a608-74b540955095 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:05.007772 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d02a8099-ca55-4a65-a608-74b540955095 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:05.008798 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d02a8099-ca55-4a65-a608-74b540955095 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:05.009273 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d02a8099-ca55-4a65-a608-74b540955095 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:05.009702 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d02a8099-ca55-4a65-a608-74b540955095 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:05.253077 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-d02a8099-ca55-4a65-a608-74b540955095 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:05.261972 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-d02a8099-ca55-4a65-a608-74b540955095 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3" status: 200 len: 1370 microversion: 2.1 time: 0.282574 Aug 09 07:05:05.272525 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 216/431] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:05:04 2022] GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3 => generated 1370 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:05:05.510039 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-08b1f066-dcb0-45d2-8ea1-5ceddfd8516c req-8ff6a213-ab3f-4736-bd0d-f619964c0c52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5e9e5b3-58c6-44f2-940a-c72b15dfd8db", "tag": "5e9f9cbf-0095-475f-a9eb-f3868a00ac39"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:05:05.532327 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-08b1f066-dcb0-45d2-8ea1-5ceddfd8516c req-8ff6a213-ab3f-4736-bd0d-f619964c0c52 service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:05.533336 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-08b1f066-dcb0-45d2-8ea1-5ceddfd8516c req-8ff6a213-ab3f-4736-bd0d-f619964c0c52 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:05.536459 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-08b1f066-dcb0-45d2-8ea1-5ceddfd8516c req-8ff6a213-ab3f-4736-bd0d-f619964c0c52 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:05.563179 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-08b1f066-dcb0-45d2-8ea1-5ceddfd8516c req-8ff6a213-ab3f-4736-bd0d-f619964c0c52 service nova] Creating event network-changed:5e9f9cbf-0095-475f-a9eb-f3868a00ac39 for instance f5e9e5b3-58c6-44f2-940a-c72b15dfd8db on hv-cinder-85251 Aug 09 07:05:05.576452 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-08b1f066-dcb0-45d2-8ea1-5ceddfd8516c req-8ff6a213-ab3f-4736-bd0d-f619964c0c52 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071279 Aug 09 07:05:05.577533 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 216/432] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:05:05.658330 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-c2b55d5a-7944-4db1-8bd2-77af75641d2a tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:05.659184 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-c2b55d5a-7944-4db1-8bd2-77af75641d2a tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:05.665726 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c2b55d5a-7944-4db1-8bd2-77af75641d2a tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:05.666477 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c2b55d5a-7944-4db1-8bd2-77af75641d2a tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:05.667078 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c2b55d5a-7944-4db1-8bd2-77af75641d2a tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:05.667971 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c2b55d5a-7944-4db1-8bd2-77af75641d2a tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:05.668573 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c2b55d5a-7944-4db1-8bd2-77af75641d2a tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:05.669150 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c2b55d5a-7944-4db1-8bd2-77af75641d2a tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:05.911582 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-c2b55d5a-7944-4db1-8bd2-77af75641d2a tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:05.920311 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-c2b55d5a-7944-4db1-8bd2-77af75641d2a tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:05.924538 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-c2b55d5a-7944-4db1-8bd2-77af75641d2a tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:05.926108 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-c2b55d5a-7944-4db1-8bd2-77af75641d2a tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1737 microversion: 2.20 time: 0.271580 Aug 09 07:05:05.947999 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 217/433] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:05:05 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1737 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:05:05.956723 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a01ec6e5-e457-43b7-8a93-0f410f2d188c tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:05.957604 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-a01ec6e5-e457-43b7-8a93-0f410f2d188c tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:05.974885 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a01ec6e5-e457-43b7-8a93-0f410f2d188c tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:05.989435 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a01ec6e5-e457-43b7-8a93-0f410f2d188c tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:05.993313 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a01ec6e5-e457-43b7-8a93-0f410f2d188c tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:05.995103 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a01ec6e5-e457-43b7-8a93-0f410f2d188c tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:05.999492 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a01ec6e5-e457-43b7-8a93-0f410f2d188c tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:06.003259 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a01ec6e5-e457-43b7-8a93-0f410f2d188c tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:06.287740 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-7a57aa76-2fe8-44ed-b2b4-944f2dafd211 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:06.289001 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-7a57aa76-2fe8-44ed-b2b4-944f2dafd211 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 51b65dde-1fef-4daa-9475-7609ac03dbc3] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:06.297654 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7a57aa76-2fe8-44ed-b2b4-944f2dafd211 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:06.305173 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7a57aa76-2fe8-44ed-b2b4-944f2dafd211 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:06.308751 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7a57aa76-2fe8-44ed-b2b4-944f2dafd211 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:06.313142 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7a57aa76-2fe8-44ed-b2b4-944f2dafd211 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:06.314471 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7a57aa76-2fe8-44ed-b2b4-944f2dafd211 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:06.317255 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7a57aa76-2fe8-44ed-b2b4-944f2dafd211 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:06.324511 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-a01ec6e5-e457-43b7-8a93-0f410f2d188c tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:06.340879 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-a01ec6e5-e457-43b7-8a93-0f410f2d188c tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1724 microversion: 2.1 time: 0.393747 Aug 09 07:05:06.350154 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 217/434] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:05:05 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1724 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:05:06.534769 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-7a57aa76-2fe8-44ed-b2b4-944f2dafd211 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:06.543426 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-7a57aa76-2fe8-44ed-b2b4-944f2dafd211 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3" status: 200 len: 1564 microversion: 2.1 time: 0.262363 Aug 09 07:05:06.547939 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 218/435] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:05:06 2022] GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3 => generated 1564 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:05:06.569462 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-83a11645-6279-4363-9125-6233faa43b4b tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:06.569959 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-83a11645-6279-4363-9125-6233faa43b4b tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 51b65dde-1fef-4daa-9475-7609ac03dbc3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:06.576989 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-83a11645-6279-4363-9125-6233faa43b4b tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:06.577689 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-83a11645-6279-4363-9125-6233faa43b4b tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:06.578347 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-83a11645-6279-4363-9125-6233faa43b4b tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:06.579244 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-83a11645-6279-4363-9125-6233faa43b4b tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:06.579891 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-83a11645-6279-4363-9125-6233faa43b4b tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:06.580478 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-83a11645-6279-4363-9125-6233faa43b4b tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:06.740108 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-83a11645-6279-4363-9125-6233faa43b4b tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.174731 Aug 09 07:05:06.741597 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 218/436] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Aug 9 07:05:06 2022] GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3/os-interface => generated 284 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 07:05:06.951558 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-e0458738-7946-4b5e-b3a5-f4bdc451c04c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:06.953154 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-e0458738-7946-4b5e-b3a5-f4bdc451c04c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:06.982444 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e0458738-7946-4b5e-b3a5-f4bdc451c04c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:06.982985 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e0458738-7946-4b5e-b3a5-f4bdc451c04c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:06.983436 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e0458738-7946-4b5e-b3a5-f4bdc451c04c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:06.984185 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e0458738-7946-4b5e-b3a5-f4bdc451c04c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:06.984643 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e0458738-7946-4b5e-b3a5-f4bdc451c04c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:06.985069 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e0458738-7946-4b5e-b3a5-f4bdc451c04c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:07.376367 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-afda8ccd-7fab-4cf1-ab64-5de10587082f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:07.377557 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-afda8ccd-7fab-4cf1-ab64-5de10587082f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:07.396426 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-afda8ccd-7fab-4cf1-ab64-5de10587082f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:07.397022 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-afda8ccd-7fab-4cf1-ab64-5de10587082f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:07.397468 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-afda8ccd-7fab-4cf1-ab64-5de10587082f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:07.398330 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-afda8ccd-7fab-4cf1-ab64-5de10587082f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:07.398967 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-afda8ccd-7fab-4cf1-ab64-5de10587082f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:07.399405 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-afda8ccd-7fab-4cf1-ab64-5de10587082f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:07.572884 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-e0458738-7946-4b5e-b3a5-f4bdc451c04c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:07.583202 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-e0458738-7946-4b5e-b3a5-f4bdc451c04c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:07.588118 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-e0458738-7946-4b5e-b3a5-f4bdc451c04c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:07.589233 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-e0458738-7946-4b5e-b3a5-f4bdc451c04c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1737 microversion: 2.20 time: 0.642635 Aug 09 07:05:07.593966 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 219/437] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:05:06 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1737 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 07:05:07.688177 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-afda8ccd-7fab-4cf1-ab64-5de10587082f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:07.703631 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-afda8ccd-7fab-4cf1-ab64-5de10587082f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1724 microversion: 2.1 time: 0.338624 Aug 09 07:05:07.705381 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 219/438] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:05:07 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1724 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:05:08.205191 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [req-f2ac9be4-2fed-41bf-94e1-d014aa43be7a req-9367d82d-af94-4270-8c39-182b4cfd425e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51b65dde-1fef-4daa-9475-7609ac03dbc3", "tag": "3d698374-c39d-4ddd-8c8b-02b917b63085"}]} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:05:08.223455 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-f2ac9be4-2fed-41bf-94e1-d014aa43be7a req-9367d82d-af94-4270-8c39-182b4cfd425e service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:08.224274 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-f2ac9be4-2fed-41bf-94e1-d014aa43be7a req-9367d82d-af94-4270-8c39-182b4cfd425e service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:08.224904 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-f2ac9be4-2fed-41bf-94e1-d014aa43be7a req-9367d82d-af94-4270-8c39-182b4cfd425e service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:08.242686 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.compute.server_external_events [req-f2ac9be4-2fed-41bf-94e1-d014aa43be7a req-9367d82d-af94-4270-8c39-182b4cfd425e service nova] Creating event network-changed:3d698374-c39d-4ddd-8c8b-02b917b63085 for instance 51b65dde-1fef-4daa-9475-7609ac03dbc3 on hv-cinder-85251 Aug 09 07:05:08.249799 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [req-f2ac9be4-2fed-41bf-94e1-d014aa43be7a req-9367d82d-af94-4270-8c39-182b4cfd425e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048198 Aug 09 07:05:08.251388 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 220/439] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:05:08.621419 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e6c072d3-dd4e-429e-86bd-50cacac86815 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:08.622251 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-e6c072d3-dd4e-429e-86bd-50cacac86815 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:08.640808 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e6c072d3-dd4e-429e-86bd-50cacac86815 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:08.641337 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e6c072d3-dd4e-429e-86bd-50cacac86815 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:08.641785 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e6c072d3-dd4e-429e-86bd-50cacac86815 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:08.642507 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e6c072d3-dd4e-429e-86bd-50cacac86815 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:08.647835 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e6c072d3-dd4e-429e-86bd-50cacac86815 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:08.648536 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e6c072d3-dd4e-429e-86bd-50cacac86815 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:08.743773 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-7b03e790-99eb-4734-8b5f-1415b147b5d7 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:08.747845 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-7b03e790-99eb-4734-8b5f-1415b147b5d7 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:08.765935 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7b03e790-99eb-4734-8b5f-1415b147b5d7 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:08.772982 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7b03e790-99eb-4734-8b5f-1415b147b5d7 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:08.774660 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7b03e790-99eb-4734-8b5f-1415b147b5d7 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:08.779168 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7b03e790-99eb-4734-8b5f-1415b147b5d7 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:08.786283 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7b03e790-99eb-4734-8b5f-1415b147b5d7 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:08.788708 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7b03e790-99eb-4734-8b5f-1415b147b5d7 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:09.018248 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e6c072d3-dd4e-429e-86bd-50cacac86815 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:09.031766 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e6c072d3-dd4e-429e-86bd-50cacac86815 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:09.040771 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e6c072d3-dd4e-429e-86bd-50cacac86815 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:09.044309 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-e6c072d3-dd4e-429e-86bd-50cacac86815 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1737 microversion: 2.20 time: 0.431117 Aug 09 07:05:09.046104 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 220/440] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:05:08 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1737 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:05:09.105209 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-7b03e790-99eb-4734-8b5f-1415b147b5d7 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:09.115657 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-7b03e790-99eb-4734-8b5f-1415b147b5d7 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1724 microversion: 2.1 time: 0.386529 Aug 09 07:05:09.117947 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 221/441] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:05:08 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1724 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:05:10.073703 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d3829e8f-657e-4a5e-9d0d-03582dfeb8e8 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:10.074969 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-d3829e8f-657e-4a5e-9d0d-03582dfeb8e8 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:10.082849 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d3829e8f-657e-4a5e-9d0d-03582dfeb8e8 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:10.083821 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d3829e8f-657e-4a5e-9d0d-03582dfeb8e8 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:10.085014 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d3829e8f-657e-4a5e-9d0d-03582dfeb8e8 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:10.085956 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d3829e8f-657e-4a5e-9d0d-03582dfeb8e8 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:10.086627 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d3829e8f-657e-4a5e-9d0d-03582dfeb8e8 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:10.087272 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d3829e8f-657e-4a5e-9d0d-03582dfeb8e8 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:10.139062 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-c2033e5b-ed8a-4b2c-a9a6-4cd0d7836027 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:10.140358 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-c2033e5b-ed8a-4b2c-a9a6-4cd0d7836027 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:10.149509 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c2033e5b-ed8a-4b2c-a9a6-4cd0d7836027 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:10.152005 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c2033e5b-ed8a-4b2c-a9a6-4cd0d7836027 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:10.152446 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c2033e5b-ed8a-4b2c-a9a6-4cd0d7836027 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:10.153151 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c2033e5b-ed8a-4b2c-a9a6-4cd0d7836027 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:10.153603 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c2033e5b-ed8a-4b2c-a9a6-4cd0d7836027 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:10.154053 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c2033e5b-ed8a-4b2c-a9a6-4cd0d7836027 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:10.338502 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d3829e8f-657e-4a5e-9d0d-03582dfeb8e8 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:10.346624 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d3829e8f-657e-4a5e-9d0d-03582dfeb8e8 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:10.348155 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d3829e8f-657e-4a5e-9d0d-03582dfeb8e8 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:10.349322 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-d3829e8f-657e-4a5e-9d0d-03582dfeb8e8 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1737 microversion: 2.20 time: 0.279749 Aug 09 07:05:10.356279 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 221/442] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:05:10 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1737 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:05:10.386326 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-c2033e5b-ed8a-4b2c-a9a6-4cd0d7836027 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:10.398239 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-c2033e5b-ed8a-4b2c-a9a6-4cd0d7836027 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1724 microversion: 2.1 time: 0.263300 Aug 09 07:05:10.404322 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 222/443] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:05:10 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1724 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:05:11.372283 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-8c186e6f-fa96-47c9-99f7-09e89dded1fc tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:11.373578 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-8c186e6f-fa96-47c9-99f7-09e89dded1fc tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:11.383959 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8c186e6f-fa96-47c9-99f7-09e89dded1fc tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:11.384491 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8c186e6f-fa96-47c9-99f7-09e89dded1fc tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:11.384935 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8c186e6f-fa96-47c9-99f7-09e89dded1fc tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:11.385674 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8c186e6f-fa96-47c9-99f7-09e89dded1fc tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:11.386118 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8c186e6f-fa96-47c9-99f7-09e89dded1fc tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:11.386543 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8c186e6f-fa96-47c9-99f7-09e89dded1fc tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:11.425260 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-5b5a47c6-dcac-45a1-aba0-35e7a2c596fb tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:11.426511 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-5b5a47c6-dcac-45a1-aba0-35e7a2c596fb tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:11.446086 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5b5a47c6-dcac-45a1-aba0-35e7a2c596fb tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:11.446605 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5b5a47c6-dcac-45a1-aba0-35e7a2c596fb tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:11.447056 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5b5a47c6-dcac-45a1-aba0-35e7a2c596fb tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:11.447852 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5b5a47c6-dcac-45a1-aba0-35e7a2c596fb tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:11.448311 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5b5a47c6-dcac-45a1-aba0-35e7a2c596fb tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:11.448909 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5b5a47c6-dcac-45a1-aba0-35e7a2c596fb tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:11.622367 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8c186e6f-fa96-47c9-99f7-09e89dded1fc tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:11.634944 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8c186e6f-fa96-47c9-99f7-09e89dded1fc tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:11.636920 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8c186e6f-fa96-47c9-99f7-09e89dded1fc tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:11.638307 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-8c186e6f-fa96-47c9-99f7-09e89dded1fc tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1737 microversion: 2.20 time: 0.270320 Aug 09 07:05:11.654599 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 222/444] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:05:11 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1737 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 07:05:11.688916 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-5b5a47c6-dcac-45a1-aba0-35e7a2c596fb tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:11.698230 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-5b5a47c6-dcac-45a1-aba0-35e7a2c596fb tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1724 microversion: 2.1 time: 0.276940 Aug 09 07:05:11.698800 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 223/445] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:05:11 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1724 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:05:12.662214 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2ad641de-ac50-4b1b-9e5a-03e57c4bcbdd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:12.662906 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-2ad641de-ac50-4b1b-9e5a-03e57c4bcbdd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:12.669193 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2ad641de-ac50-4b1b-9e5a-03e57c4bcbdd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:12.669674 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2ad641de-ac50-4b1b-9e5a-03e57c4bcbdd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:12.670108 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2ad641de-ac50-4b1b-9e5a-03e57c4bcbdd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:12.670794 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2ad641de-ac50-4b1b-9e5a-03e57c4bcbdd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:12.671244 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2ad641de-ac50-4b1b-9e5a-03e57c4bcbdd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:12.671696 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2ad641de-ac50-4b1b-9e5a-03e57c4bcbdd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:12.720461 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-0bfa80d7-d7f1-408b-85ac-e08ba92b7837 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:12.721071 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-0bfa80d7-d7f1-408b-85ac-e08ba92b7837 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:12.726909 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0bfa80d7-d7f1-408b-85ac-e08ba92b7837 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:12.727389 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0bfa80d7-d7f1-408b-85ac-e08ba92b7837 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:12.727862 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0bfa80d7-d7f1-408b-85ac-e08ba92b7837 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:12.728551 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0bfa80d7-d7f1-408b-85ac-e08ba92b7837 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:12.729005 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0bfa80d7-d7f1-408b-85ac-e08ba92b7837 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:12.729426 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0bfa80d7-d7f1-408b-85ac-e08ba92b7837 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:12.842128 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2ad641de-ac50-4b1b-9e5a-03e57c4bcbdd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:12.850356 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2ad641de-ac50-4b1b-9e5a-03e57c4bcbdd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:12.852024 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2ad641de-ac50-4b1b-9e5a-03e57c4bcbdd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:12.853271 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-2ad641de-ac50-4b1b-9e5a-03e57c4bcbdd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1737 microversion: 2.20 time: 0.195004 Aug 09 07:05:12.853903 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 223/446] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:05:12 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1737 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:05:12.885349 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-0bfa80d7-d7f1-408b-85ac-e08ba92b7837 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:12.893305 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-0bfa80d7-d7f1-408b-85ac-e08ba92b7837 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1701 microversion: 2.1 time: 0.176678 Aug 09 07:05:12.893867 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 224/447] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:05:12 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1701 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:05:12.913890 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-7cbc8a7b-692b-4658-b5f1-9789f5508250 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:05:12.919928 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7cbc8a7b-692b-4658-b5f1-9789f5508250 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:12.920404 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7cbc8a7b-692b-4658-b5f1-9789f5508250 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:12.920834 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7cbc8a7b-692b-4658-b5f1-9789f5508250 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:12.943808 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-7cbc8a7b-692b-4658-b5f1-9789f5508250 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Going to try to start instance {{(pid=117859) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 09 07:05:12.986458 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-7cbc8a7b-692b-4658-b5f1-9789f5508250 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "POST /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46/action" status: 202 len: 0 microversion: 2.1 time: 0.076319 Aug 09 07:05:12.987412 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 224/448] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 9 07:05:12 2022] POST /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 07:05:12.995955 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-d15755c4-cfad-45b6-a01b-fc348dcc87a5 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:12.996569 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-d15755c4-cfad-45b6-a01b-fc348dcc87a5 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:13.002526 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d15755c4-cfad-45b6-a01b-fc348dcc87a5 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:13.003001 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d15755c4-cfad-45b6-a01b-fc348dcc87a5 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:13.003432 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d15755c4-cfad-45b6-a01b-fc348dcc87a5 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:13.004413 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d15755c4-cfad-45b6-a01b-fc348dcc87a5 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:13.004864 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d15755c4-cfad-45b6-a01b-fc348dcc87a5 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:13.005283 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d15755c4-cfad-45b6-a01b-fc348dcc87a5 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:13.144942 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-d15755c4-cfad-45b6-a01b-fc348dcc87a5 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:13.153892 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-d15755c4-cfad-45b6-a01b-fc348dcc87a5 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1710 microversion: 2.1 time: 0.161750 Aug 09 07:05:13.154447 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 225/449] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:05:12 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1710 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:05:13.877832 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-ce98e550-7b45-4092-849f-eabcf0eed593 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:13.878514 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-ce98e550-7b45-4092-849f-eabcf0eed593 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:13.886184 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ce98e550-7b45-4092-849f-eabcf0eed593 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:13.886665 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ce98e550-7b45-4092-849f-eabcf0eed593 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:13.887094 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ce98e550-7b45-4092-849f-eabcf0eed593 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:13.887809 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ce98e550-7b45-4092-849f-eabcf0eed593 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:13.888256 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ce98e550-7b45-4092-849f-eabcf0eed593 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:13.888672 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ce98e550-7b45-4092-849f-eabcf0eed593 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:14.024484 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ce98e550-7b45-4092-849f-eabcf0eed593 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:14.032860 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ce98e550-7b45-4092-849f-eabcf0eed593 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:14.034350 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ce98e550-7b45-4092-849f-eabcf0eed593 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:14.035772 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-ce98e550-7b45-4092-849f-eabcf0eed593 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1719 microversion: 2.20 time: 0.162206 Aug 09 07:05:14.036329 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 225/450] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:05:13 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1719 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:05:14.175966 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-f72a6145-c98f-4f9b-b650-d586338b6371 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:14.176577 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-f72a6145-c98f-4f9b-b650-d586338b6371 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:14.183152 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f72a6145-c98f-4f9b-b650-d586338b6371 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:14.183656 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f72a6145-c98f-4f9b-b650-d586338b6371 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:14.184092 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f72a6145-c98f-4f9b-b650-d586338b6371 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:14.184774 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f72a6145-c98f-4f9b-b650-d586338b6371 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:14.185228 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f72a6145-c98f-4f9b-b650-d586338b6371 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:14.185652 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f72a6145-c98f-4f9b-b650-d586338b6371 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:14.312129 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-f72a6145-c98f-4f9b-b650-d586338b6371 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:14.320266 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-f72a6145-c98f-4f9b-b650-d586338b6371 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1710 microversion: 2.1 time: 0.148112 Aug 09 07:05:14.320827 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 226/451] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:05:14 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1710 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:05:15.059543 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-72deee7c-4fce-43fc-a62d-48a87d5cefe6 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:15.060082 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-72deee7c-4fce-43fc-a62d-48a87d5cefe6 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:15.066726 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-72deee7c-4fce-43fc-a62d-48a87d5cefe6 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:15.067200 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-72deee7c-4fce-43fc-a62d-48a87d5cefe6 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:15.067647 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-72deee7c-4fce-43fc-a62d-48a87d5cefe6 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:15.068909 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-72deee7c-4fce-43fc-a62d-48a87d5cefe6 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:15.069395 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-72deee7c-4fce-43fc-a62d-48a87d5cefe6 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:15.069816 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-72deee7c-4fce-43fc-a62d-48a87d5cefe6 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:15.202004 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-72deee7c-4fce-43fc-a62d-48a87d5cefe6 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:15.210077 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-72deee7c-4fce-43fc-a62d-48a87d5cefe6 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:15.211554 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-72deee7c-4fce-43fc-a62d-48a87d5cefe6 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:15.212731 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-72deee7c-4fce-43fc-a62d-48a87d5cefe6 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1719 microversion: 2.20 time: 0.157322 Aug 09 07:05:15.213282 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 226/452] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:05:15 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1719 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:05:15.341425 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-a0f26347-0af0-49fc-a439-aa419a5c61f3 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:15.341961 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-a0f26347-0af0-49fc-a439-aa419a5c61f3 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:15.347952 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a0f26347-0af0-49fc-a439-aa419a5c61f3 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:15.348433 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a0f26347-0af0-49fc-a439-aa419a5c61f3 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:15.348896 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a0f26347-0af0-49fc-a439-aa419a5c61f3 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:15.349604 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a0f26347-0af0-49fc-a439-aa419a5c61f3 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:15.350076 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a0f26347-0af0-49fc-a439-aa419a5c61f3 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:15.350472 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a0f26347-0af0-49fc-a439-aa419a5c61f3 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:15.475627 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-a0f26347-0af0-49fc-a439-aa419a5c61f3 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:15.483390 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-a0f26347-0af0-49fc-a439-aa419a5c61f3 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1710 microversion: 2.1 time: 0.145893 Aug 09 07:05:15.483981 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 227/453] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:05:15 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1710 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:05:16.234687 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-05ec1ab0-3caf-48a1-b817-5be909bc4a83 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:16.235328 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-05ec1ab0-3caf-48a1-b817-5be909bc4a83 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:16.241933 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-05ec1ab0-3caf-48a1-b817-5be909bc4a83 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:16.242420 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-05ec1ab0-3caf-48a1-b817-5be909bc4a83 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:16.242857 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-05ec1ab0-3caf-48a1-b817-5be909bc4a83 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:16.243549 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-05ec1ab0-3caf-48a1-b817-5be909bc4a83 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:16.244042 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-05ec1ab0-3caf-48a1-b817-5be909bc4a83 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:16.244472 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-05ec1ab0-3caf-48a1-b817-5be909bc4a83 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:16.373268 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-05ec1ab0-3caf-48a1-b817-5be909bc4a83 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:16.381582 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-05ec1ab0-3caf-48a1-b817-5be909bc4a83 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:16.383642 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-05ec1ab0-3caf-48a1-b817-5be909bc4a83 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:16.384820 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-05ec1ab0-3caf-48a1-b817-5be909bc4a83 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1662 microversion: 2.20 time: 0.154151 Aug 09 07:05:16.385379 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 227/454] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:05:16 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1662 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:05:16.407455 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-d7f671bf-d48f-4575-87f4-138e96184e63 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e8d10615-3582-4706-9c4a-e2eacd635fe4"}} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:05:16.410069 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-d7f671bf-d48f-4575-87f4-138e96184e63 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:16.416293 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d7f671bf-d48f-4575-87f4-138e96184e63 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:16.416797 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d7f671bf-d48f-4575-87f4-138e96184e63 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:16.417226 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d7f671bf-d48f-4575-87f4-138e96184e63 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:16.417914 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d7f671bf-d48f-4575-87f4-138e96184e63 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:16.418359 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d7f671bf-d48f-4575-87f4-138e96184e63 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:16.418774 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d7f671bf-d48f-4575-87f4-138e96184e63 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:16.459383 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-99f604c5-090c-4adc-83eb-b389eac20d3e req-67169663-c18d-4cb9-a4d0-799f9a9c2fac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2236b6b2-39b4-4b81-bb86-006774babc2e", "name": "network-vif-unplugged", "status": "completed", "tag": "ada64d06-0764-4487-9425-780bad419035"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:05:16.470019 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-99f604c5-090c-4adc-83eb-b389eac20d3e req-67169663-c18d-4cb9-a4d0-799f9a9c2fac service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:16.470642 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-99f604c5-090c-4adc-83eb-b389eac20d3e req-67169663-c18d-4cb9-a4d0-799f9a9c2fac service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:16.471107 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-99f604c5-090c-4adc-83eb-b389eac20d3e req-67169663-c18d-4cb9-a4d0-799f9a9c2fac service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:16.483198 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.compute.server_external_events [req-99f604c5-090c-4adc-83eb-b389eac20d3e req-67169663-c18d-4cb9-a4d0-799f9a9c2fac service nova] Unable to find a host for instance 2236b6b2-39b4-4b81-bb86-006774babc2e. Dropping event network-vif-unplugged {{(pid=117859) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 09 07:05:16.484152 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-99f604c5-090c-4adc-83eb-b389eac20d3e req-67169663-c18d-4cb9-a4d0-799f9a9c2fac service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028705 Aug 09 07:05:16.484737 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 228/455] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:05:16 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 09 07:05:16.505475 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-04e5f881-dd05-4972-a8ae-3fc14295286d tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:16.506380 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-04e5f881-dd05-4972-a8ae-3fc14295286d tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:16.513493 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-04e5f881-dd05-4972-a8ae-3fc14295286d tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:16.514109 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-04e5f881-dd05-4972-a8ae-3fc14295286d tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:16.514648 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-04e5f881-dd05-4972-a8ae-3fc14295286d tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:16.515468 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-04e5f881-dd05-4972-a8ae-3fc14295286d tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:16.516057 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-04e5f881-dd05-4972-a8ae-3fc14295286d tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:16.516576 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-04e5f881-dd05-4972-a8ae-3fc14295286d tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:16.543061 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:05:16.625087 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:05:16.669079 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-04e5f881-dd05-4972-a8ae-3fc14295286d tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:16.684748 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-04e5f881-dd05-4972-a8ae-3fc14295286d tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1714 microversion: 2.1 time: 0.183126 Aug 09 07:05:16.686589 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 229/456] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:05:16 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1714 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:05:16.739190 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-d7f671bf-d48f-4575-87f4-138e96184e63 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "POST /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.335796 Aug 09 07:05:16.739850 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 228/457] 10.222.0.30 () {62 vars in 1364 bytes} [Tue Aug 9 07:05:16 2022] POST /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e/os-volume_attachments => generated 188 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 07:05:16.861453 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-5578e957-f744-46e2-a549-7d6a6ec53f96 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:05:16.862055 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-5578e957-f744-46e2-a549-7d6a6ec53f96 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:16.868688 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5578e957-f744-46e2-a549-7d6a6ec53f96 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:16.869174 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5578e957-f744-46e2-a549-7d6a6ec53f96 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:16.869616 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5578e957-f744-46e2-a549-7d6a6ec53f96 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:16.870308 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5578e957-f744-46e2-a549-7d6a6ec53f96 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:16.870763 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5578e957-f744-46e2-a549-7d6a6ec53f96 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:16.871190 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5578e957-f744-46e2-a549-7d6a6ec53f96 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:16.913233 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-5578e957-f744-46e2-a549-7d6a6ec53f96 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117859) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 09 07:05:16.978523 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-5578e957-f744-46e2-a549-7d6a6ec53f96 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "POST /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e/action" status: 202 len: 0 microversion: 2.20 time: 0.120983 Aug 09 07:05:16.979125 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 230/458] 10.222.0.30 () {62 vars in 1319 bytes} [Tue Aug 9 07:05:16 2022] POST /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 07:05:16.987219 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-105e4083-5efe-41a6-a354-4f75ebfdbe68 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:16.987861 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-105e4083-5efe-41a6-a354-4f75ebfdbe68 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:16.994735 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-105e4083-5efe-41a6-a354-4f75ebfdbe68 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:16.995220 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-105e4083-5efe-41a6-a354-4f75ebfdbe68 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:16.995677 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-105e4083-5efe-41a6-a354-4f75ebfdbe68 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:16.996376 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-105e4083-5efe-41a6-a354-4f75ebfdbe68 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:16.996828 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-105e4083-5efe-41a6-a354-4f75ebfdbe68 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:16.997250 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-105e4083-5efe-41a6-a354-4f75ebfdbe68 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:17.131732 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-105e4083-5efe-41a6-a354-4f75ebfdbe68 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:17.140303 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-105e4083-5efe-41a6-a354-4f75ebfdbe68 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:17.141809 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-105e4083-5efe-41a6-a354-4f75ebfdbe68 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:17.142957 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-105e4083-5efe-41a6-a354-4f75ebfdbe68 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1748 microversion: 2.20 time: 0.159590 Aug 09 07:05:17.143892 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 229/459] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:05:16 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1748 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:05:18.166332 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-952466b0-049a-498a-973f-1c41530b80c4 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:18.166945 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-952466b0-049a-498a-973f-1c41530b80c4 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:18.173520 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-952466b0-049a-498a-973f-1c41530b80c4 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:18.174014 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-952466b0-049a-498a-973f-1c41530b80c4 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:18.174449 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-952466b0-049a-498a-973f-1c41530b80c4 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:18.175165 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-952466b0-049a-498a-973f-1c41530b80c4 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:18.175684 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-952466b0-049a-498a-973f-1c41530b80c4 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:18.176114 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-952466b0-049a-498a-973f-1c41530b80c4 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:18.314511 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-952466b0-049a-498a-973f-1c41530b80c4 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:18.327524 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-952466b0-049a-498a-973f-1c41530b80c4 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:18.328936 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-952466b0-049a-498a-973f-1c41530b80c4 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:18.330197 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-952466b0-049a-498a-973f-1c41530b80c4 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1748 microversion: 2.20 time: 0.168633 Aug 09 07:05:18.332475 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 231/460] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:05:18 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1748 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:05:19.354412 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-5babbc0a-9aa6-4955-862b-d7e625e573fb tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:19.355021 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-5babbc0a-9aa6-4955-862b-d7e625e573fb tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:19.356986 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_api:SELECT=78 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:05:19.362391 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5babbc0a-9aa6-4955-862b-d7e625e573fb tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:19.362875 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5babbc0a-9aa6-4955-862b-d7e625e573fb tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:19.363315 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5babbc0a-9aa6-4955-862b-d7e625e573fb tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:19.364035 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5babbc0a-9aa6-4955-862b-d7e625e573fb tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:19.364488 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5babbc0a-9aa6-4955-862b-d7e625e573fb tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:19.364910 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5babbc0a-9aa6-4955-862b-d7e625e573fb tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:19.508430 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-5babbc0a-9aa6-4955-862b-d7e625e573fb tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:19.517442 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-5babbc0a-9aa6-4955-862b-d7e625e573fb tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:19.519074 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-5babbc0a-9aa6-4955-862b-d7e625e573fb tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:19.520374 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-5babbc0a-9aa6-4955-862b-d7e625e573fb tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1806 microversion: 2.20 time: 0.170517 Aug 09 07:05:19.521238 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 230/461] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:05:19 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1806 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:05:20.543145 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-479add23-0f60-4b81-9059-d6fd9d2da53a tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:20.543785 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-479add23-0f60-4b81-9059-d6fd9d2da53a tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:20.555855 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-479add23-0f60-4b81-9059-d6fd9d2da53a tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:20.556728 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-479add23-0f60-4b81-9059-d6fd9d2da53a tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:20.557370 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-479add23-0f60-4b81-9059-d6fd9d2da53a tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:20.558294 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-479add23-0f60-4b81-9059-d6fd9d2da53a tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:20.558946 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-479add23-0f60-4b81-9059-d6fd9d2da53a tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:20.559570 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-479add23-0f60-4b81-9059-d6fd9d2da53a tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:20.709100 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-479add23-0f60-4b81-9059-d6fd9d2da53a tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:20.718635 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-479add23-0f60-4b81-9059-d6fd9d2da53a tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:20.720544 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-479add23-0f60-4b81-9059-d6fd9d2da53a tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:20.722028 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-479add23-0f60-4b81-9059-d6fd9d2da53a tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1806 microversion: 2.20 time: 0.183627 Aug 09 07:05:20.722676 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 232/462] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:05:20 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1806 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:05:21.745082 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-36fea41f-7e58-4316-9bf8-d5111f476d04 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:21.745690 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-36fea41f-7e58-4316-9bf8-d5111f476d04 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:21.752798 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-36fea41f-7e58-4316-9bf8-d5111f476d04 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:21.753381 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-36fea41f-7e58-4316-9bf8-d5111f476d04 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:21.754194 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-36fea41f-7e58-4316-9bf8-d5111f476d04 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:21.754952 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-36fea41f-7e58-4316-9bf8-d5111f476d04 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:21.755468 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-36fea41f-7e58-4316-9bf8-d5111f476d04 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:21.755987 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-36fea41f-7e58-4316-9bf8-d5111f476d04 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:21.896830 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-36fea41f-7e58-4316-9bf8-d5111f476d04 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:21.905611 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-36fea41f-7e58-4316-9bf8-d5111f476d04 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:21.907197 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-36fea41f-7e58-4316-9bf8-d5111f476d04 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:21.908402 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-36fea41f-7e58-4316-9bf8-d5111f476d04 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1806 microversion: 2.20 time: 0.167365 Aug 09 07:05:21.909155 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 231/463] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:05:21 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1806 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:05:22.930605 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-958c2ff7-93dc-47ca-9d21-a231ba0fb44d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:22.931240 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-958c2ff7-93dc-47ca-9d21-a231ba0fb44d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:22.938346 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-958c2ff7-93dc-47ca-9d21-a231ba0fb44d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:22.938828 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-958c2ff7-93dc-47ca-9d21-a231ba0fb44d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:22.939258 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-958c2ff7-93dc-47ca-9d21-a231ba0fb44d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:22.940055 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-958c2ff7-93dc-47ca-9d21-a231ba0fb44d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:22.940504 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-958c2ff7-93dc-47ca-9d21-a231ba0fb44d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:22.940930 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-958c2ff7-93dc-47ca-9d21-a231ba0fb44d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:23.080082 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-958c2ff7-93dc-47ca-9d21-a231ba0fb44d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:23.090589 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-958c2ff7-93dc-47ca-9d21-a231ba0fb44d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:23.092611 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-958c2ff7-93dc-47ca-9d21-a231ba0fb44d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:23.093925 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-958c2ff7-93dc-47ca-9d21-a231ba0fb44d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1806 microversion: 2.20 time: 0.167438 Aug 09 07:05:23.099754 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 233/464] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:05:22 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1806 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:05:24.118043 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-51af7364-b85b-4c5a-97a1-ef6ad1058059 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:24.118712 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-51af7364-b85b-4c5a-97a1-ef6ad1058059 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:24.125423 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-51af7364-b85b-4c5a-97a1-ef6ad1058059 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:24.126076 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-51af7364-b85b-4c5a-97a1-ef6ad1058059 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:24.126524 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-51af7364-b85b-4c5a-97a1-ef6ad1058059 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:24.127233 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-51af7364-b85b-4c5a-97a1-ef6ad1058059 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:24.127717 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-51af7364-b85b-4c5a-97a1-ef6ad1058059 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:24.128143 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-51af7364-b85b-4c5a-97a1-ef6ad1058059 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:24.266511 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-51af7364-b85b-4c5a-97a1-ef6ad1058059 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:24.275285 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-51af7364-b85b-4c5a-97a1-ef6ad1058059 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:24.276826 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-51af7364-b85b-4c5a-97a1-ef6ad1058059 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:24.278832 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-51af7364-b85b-4c5a-97a1-ef6ad1058059 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1806 microversion: 2.20 time: 0.165742 Aug 09 07:05:24.279623 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 232/465] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:05:24 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1806 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:05:25.300775 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-37c90ff5-21d0-4b96-b54a-23835a75378d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:25.301386 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-37c90ff5-21d0-4b96-b54a-23835a75378d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:25.308633 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-37c90ff5-21d0-4b96-b54a-23835a75378d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:25.309124 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-37c90ff5-21d0-4b96-b54a-23835a75378d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:25.309558 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-37c90ff5-21d0-4b96-b54a-23835a75378d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:25.310251 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-37c90ff5-21d0-4b96-b54a-23835a75378d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:25.310701 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-37c90ff5-21d0-4b96-b54a-23835a75378d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:25.311122 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-37c90ff5-21d0-4b96-b54a-23835a75378d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:25.445627 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-37c90ff5-21d0-4b96-b54a-23835a75378d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:25.454346 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-37c90ff5-21d0-4b96-b54a-23835a75378d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:25.455868 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-37c90ff5-21d0-4b96-b54a-23835a75378d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:25.457028 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-37c90ff5-21d0-4b96-b54a-23835a75378d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1806 microversion: 2.20 time: 0.160237 Aug 09 07:05:25.457589 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 234/466] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:05:25 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:05:26.480850 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-1d38231a-5b90-48e0-a489-41aa3da436e1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:26.481450 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-1d38231a-5b90-48e0-a489-41aa3da436e1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:26.487559 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1d38231a-5b90-48e0-a489-41aa3da436e1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:26.488126 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1d38231a-5b90-48e0-a489-41aa3da436e1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:26.488559 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1d38231a-5b90-48e0-a489-41aa3da436e1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:26.489244 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1d38231a-5b90-48e0-a489-41aa3da436e1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:26.489689 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1d38231a-5b90-48e0-a489-41aa3da436e1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:26.490103 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1d38231a-5b90-48e0-a489-41aa3da436e1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:26.630615 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-1d38231a-5b90-48e0-a489-41aa3da436e1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:26.641250 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-1d38231a-5b90-48e0-a489-41aa3da436e1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:26.643089 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-1d38231a-5b90-48e0-a489-41aa3da436e1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:26.644486 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-1d38231a-5b90-48e0-a489-41aa3da436e1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1806 microversion: 2.20 time: 0.167538 Aug 09 07:05:26.645120 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 233/467] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:05:26 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1806 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:05:27.672220 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4fd35087-9e5d-4f30-a250-6902e50f9cf1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:27.672852 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4fd35087-9e5d-4f30-a250-6902e50f9cf1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:27.675203 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:05:27.681471 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4fd35087-9e5d-4f30-a250-6902e50f9cf1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:27.681984 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4fd35087-9e5d-4f30-a250-6902e50f9cf1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:27.682419 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4fd35087-9e5d-4f30-a250-6902e50f9cf1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:27.683119 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4fd35087-9e5d-4f30-a250-6902e50f9cf1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:27.683609 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4fd35087-9e5d-4f30-a250-6902e50f9cf1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:27.684066 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4fd35087-9e5d-4f30-a250-6902e50f9cf1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:27.827956 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4fd35087-9e5d-4f30-a250-6902e50f9cf1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:27.837161 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4fd35087-9e5d-4f30-a250-6902e50f9cf1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:27.838654 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4fd35087-9e5d-4f30-a250-6902e50f9cf1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:27.839869 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4fd35087-9e5d-4f30-a250-6902e50f9cf1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1806 microversion: 2.20 time: 0.171648 Aug 09 07:05:27.840651 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 235/468] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:05:27 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1806 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:05:28.862648 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-b05f8591-f4e2-4894-a3cb-83be941a9f91 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:28.863149 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-b05f8591-f4e2-4894-a3cb-83be941a9f91 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:28.870027 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b05f8591-f4e2-4894-a3cb-83be941a9f91 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:28.870754 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b05f8591-f4e2-4894-a3cb-83be941a9f91 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:28.871197 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b05f8591-f4e2-4894-a3cb-83be941a9f91 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:28.871920 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b05f8591-f4e2-4894-a3cb-83be941a9f91 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:28.872372 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b05f8591-f4e2-4894-a3cb-83be941a9f91 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:28.872791 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b05f8591-f4e2-4894-a3cb-83be941a9f91 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:29.016313 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-b05f8591-f4e2-4894-a3cb-83be941a9f91 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:29.025221 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-b05f8591-f4e2-4894-a3cb-83be941a9f91 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:29.026711 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-b05f8591-f4e2-4894-a3cb-83be941a9f91 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:29.027894 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-b05f8591-f4e2-4894-a3cb-83be941a9f91 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1806 microversion: 2.20 time: 0.169242 Aug 09 07:05:29.028704 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 234/469] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:05:28 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1806 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:05:30.051091 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-0f26abf2-2288-4834-9a24-8c32f0b2c635 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:30.051748 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-0f26abf2-2288-4834-9a24-8c32f0b2c635 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:30.058763 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0f26abf2-2288-4834-9a24-8c32f0b2c635 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:30.059334 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0f26abf2-2288-4834-9a24-8c32f0b2c635 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:30.059884 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0f26abf2-2288-4834-9a24-8c32f0b2c635 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:30.060661 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0f26abf2-2288-4834-9a24-8c32f0b2c635 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:30.061194 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0f26abf2-2288-4834-9a24-8c32f0b2c635 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:30.061726 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0f26abf2-2288-4834-9a24-8c32f0b2c635 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:30.211165 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-0f26abf2-2288-4834-9a24-8c32f0b2c635 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:30.220226 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-0f26abf2-2288-4834-9a24-8c32f0b2c635 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:30.221778 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-0f26abf2-2288-4834-9a24-8c32f0b2c635 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:30.222930 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-0f26abf2-2288-4834-9a24-8c32f0b2c635 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1806 microversion: 2.20 time: 0.175691 Aug 09 07:05:30.223767 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 236/470] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:05:30 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1806 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:05:31.247365 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-7c5902bf-edeb-4e4c-bccb-8fe67d8db5eb tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:31.248057 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-7c5902bf-edeb-4e4c-bccb-8fe67d8db5eb tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:31.254240 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7c5902bf-edeb-4e4c-bccb-8fe67d8db5eb tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:31.254714 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7c5902bf-edeb-4e4c-bccb-8fe67d8db5eb tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:31.255140 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7c5902bf-edeb-4e4c-bccb-8fe67d8db5eb tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:31.255841 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7c5902bf-edeb-4e4c-bccb-8fe67d8db5eb tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:31.256287 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7c5902bf-edeb-4e4c-bccb-8fe67d8db5eb tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:31.256703 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7c5902bf-edeb-4e4c-bccb-8fe67d8db5eb tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:31.382245 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-7c5902bf-edeb-4e4c-bccb-8fe67d8db5eb tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:31.390462 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-7c5902bf-edeb-4e4c-bccb-8fe67d8db5eb tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:31.391975 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-7c5902bf-edeb-4e4c-bccb-8fe67d8db5eb tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:31.393123 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-7c5902bf-edeb-4e4c-bccb-8fe67d8db5eb tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1806 microversion: 2.20 time: 0.150333 Aug 09 07:05:31.393669 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 235/471] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:05:31 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1806 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:05:32.415590 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-5bd70aae-5850-44ba-bd49-2a8ea2506252 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:32.416268 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-5bd70aae-5850-44ba-bd49-2a8ea2506252 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:32.422667 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5bd70aae-5850-44ba-bd49-2a8ea2506252 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:32.423154 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5bd70aae-5850-44ba-bd49-2a8ea2506252 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:32.423630 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5bd70aae-5850-44ba-bd49-2a8ea2506252 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:32.424309 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5bd70aae-5850-44ba-bd49-2a8ea2506252 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:32.424766 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5bd70aae-5850-44ba-bd49-2a8ea2506252 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:32.425194 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5bd70aae-5850-44ba-bd49-2a8ea2506252 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:32.560860 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-5bd70aae-5850-44ba-bd49-2a8ea2506252 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:32.569184 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-5bd70aae-5850-44ba-bd49-2a8ea2506252 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:32.571407 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-5bd70aae-5850-44ba-bd49-2a8ea2506252 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:32.572593 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-5bd70aae-5850-44ba-bd49-2a8ea2506252 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1806 microversion: 2.20 time: 0.160933 Aug 09 07:05:32.573143 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 237/472] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:05:32 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:05:33.595646 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-938a8a61-741f-46d0-882b-313b5c87cd90 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:33.596199 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-938a8a61-741f-46d0-882b-313b5c87cd90 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:33.602184 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-938a8a61-741f-46d0-882b-313b5c87cd90 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:33.602668 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-938a8a61-741f-46d0-882b-313b5c87cd90 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:33.603107 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-938a8a61-741f-46d0-882b-313b5c87cd90 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:33.603834 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-938a8a61-741f-46d0-882b-313b5c87cd90 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:33.604290 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-938a8a61-741f-46d0-882b-313b5c87cd90 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:33.604722 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-938a8a61-741f-46d0-882b-313b5c87cd90 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:33.735901 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-938a8a61-741f-46d0-882b-313b5c87cd90 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:33.744798 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-938a8a61-741f-46d0-882b-313b5c87cd90 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:33.746310 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-938a8a61-741f-46d0-882b-313b5c87cd90 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:33.747519 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-938a8a61-741f-46d0-882b-313b5c87cd90 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1806 microversion: 2.20 time: 0.155862 Aug 09 07:05:33.748101 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 236/473] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:05:33 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:05:34.770479 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-50b9ed40-02b2-4a09-bae8-3a8218099525 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:34.771088 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-50b9ed40-02b2-4a09-bae8-3a8218099525 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:34.777601 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-50b9ed40-02b2-4a09-bae8-3a8218099525 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:34.778082 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-50b9ed40-02b2-4a09-bae8-3a8218099525 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:34.778517 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-50b9ed40-02b2-4a09-bae8-3a8218099525 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:34.779207 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-50b9ed40-02b2-4a09-bae8-3a8218099525 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:34.779689 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-50b9ed40-02b2-4a09-bae8-3a8218099525 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:34.780119 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-50b9ed40-02b2-4a09-bae8-3a8218099525 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:34.916118 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-50b9ed40-02b2-4a09-bae8-3a8218099525 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:34.924402 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-50b9ed40-02b2-4a09-bae8-3a8218099525 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:34.925884 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-50b9ed40-02b2-4a09-bae8-3a8218099525 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:34.927025 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-50b9ed40-02b2-4a09-bae8-3a8218099525 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1806 microversion: 2.20 time: 0.160519 Aug 09 07:05:34.927572 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 238/474] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:05:34 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:05:35.950890 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-82792a30-532e-425f-929f-50f2ae84cb9d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:35.951499 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-82792a30-532e-425f-929f-50f2ae84cb9d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:35.957381 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-82792a30-532e-425f-929f-50f2ae84cb9d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:35.957863 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-82792a30-532e-425f-929f-50f2ae84cb9d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:35.958297 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-82792a30-532e-425f-929f-50f2ae84cb9d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:35.958982 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-82792a30-532e-425f-929f-50f2ae84cb9d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:35.959469 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-82792a30-532e-425f-929f-50f2ae84cb9d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:35.959921 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-82792a30-532e-425f-929f-50f2ae84cb9d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:36.086597 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-82792a30-532e-425f-929f-50f2ae84cb9d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:36.094822 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-82792a30-532e-425f-929f-50f2ae84cb9d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:36.096349 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-82792a30-532e-425f-929f-50f2ae84cb9d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:36.097502 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-82792a30-532e-425f-929f-50f2ae84cb9d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1806 microversion: 2.20 time: 0.150490 Aug 09 07:05:36.098052 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 237/475] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:05:35 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1806 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:05:37.120629 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-9bb8b94d-0ffa-4d91-b4a2-0600cd5e889b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:37.121270 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-9bb8b94d-0ffa-4d91-b4a2-0600cd5e889b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:37.127695 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9bb8b94d-0ffa-4d91-b4a2-0600cd5e889b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:37.128202 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9bb8b94d-0ffa-4d91-b4a2-0600cd5e889b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:37.128639 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9bb8b94d-0ffa-4d91-b4a2-0600cd5e889b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:37.129578 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9bb8b94d-0ffa-4d91-b4a2-0600cd5e889b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:37.130029 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9bb8b94d-0ffa-4d91-b4a2-0600cd5e889b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:37.130449 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9bb8b94d-0ffa-4d91-b4a2-0600cd5e889b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:37.262338 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-9bb8b94d-0ffa-4d91-b4a2-0600cd5e889b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:37.270569 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-9bb8b94d-0ffa-4d91-b4a2-0600cd5e889b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:37.272102 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-9bb8b94d-0ffa-4d91-b4a2-0600cd5e889b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:37.274074 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-9bb8b94d-0ffa-4d91-b4a2-0600cd5e889b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1806 microversion: 2.20 time: 0.157412 Aug 09 07:05:37.274630 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 239/476] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:05:37 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:05:38.296621 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-d57dadc8-b1cc-4afb-968f-49ac0ce76ae1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:38.297224 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-d57dadc8-b1cc-4afb-968f-49ac0ce76ae1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:38.303125 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d57dadc8-b1cc-4afb-968f-49ac0ce76ae1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:38.303667 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d57dadc8-b1cc-4afb-968f-49ac0ce76ae1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:38.304108 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d57dadc8-b1cc-4afb-968f-49ac0ce76ae1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:38.304788 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d57dadc8-b1cc-4afb-968f-49ac0ce76ae1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:38.305235 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d57dadc8-b1cc-4afb-968f-49ac0ce76ae1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:38.305680 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d57dadc8-b1cc-4afb-968f-49ac0ce76ae1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:38.433967 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-d57dadc8-b1cc-4afb-968f-49ac0ce76ae1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:38.442267 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-d57dadc8-b1cc-4afb-968f-49ac0ce76ae1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:38.443797 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-d57dadc8-b1cc-4afb-968f-49ac0ce76ae1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:38.445101 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-d57dadc8-b1cc-4afb-968f-49ac0ce76ae1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1806 microversion: 2.20 time: 0.152467 Aug 09 07:05:38.445658 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 238/477] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:05:38 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1806 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:05:39.467688 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-0dcf1ef4-c1f7-470c-8494-30a2c6725714 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:39.468300 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-0dcf1ef4-c1f7-470c-8494-30a2c6725714 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:39.474650 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0dcf1ef4-c1f7-470c-8494-30a2c6725714 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:39.475132 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0dcf1ef4-c1f7-470c-8494-30a2c6725714 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:39.476315 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0dcf1ef4-c1f7-470c-8494-30a2c6725714 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:39.477180 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0dcf1ef4-c1f7-470c-8494-30a2c6725714 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:39.477668 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0dcf1ef4-c1f7-470c-8494-30a2c6725714 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:39.478092 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0dcf1ef4-c1f7-470c-8494-30a2c6725714 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:39.606082 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-0dcf1ef4-c1f7-470c-8494-30a2c6725714 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:39.614827 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-0dcf1ef4-c1f7-470c-8494-30a2c6725714 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:39.616963 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-0dcf1ef4-c1f7-470c-8494-30a2c6725714 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:39.618212 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-0dcf1ef4-c1f7-470c-8494-30a2c6725714 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1806 microversion: 2.20 time: 0.154507 Aug 09 07:05:39.618761 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 240/478] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:05:39 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1806 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:05:40.641200 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-8da73343-dabf-4333-b51f-d7b125ae5f19 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:40.641950 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-8da73343-dabf-4333-b51f-d7b125ae5f19 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:40.647802 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-8da73343-dabf-4333-b51f-d7b125ae5f19 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:40.648394 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-8da73343-dabf-4333-b51f-d7b125ae5f19 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:40.648830 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-8da73343-dabf-4333-b51f-d7b125ae5f19 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:40.649518 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-8da73343-dabf-4333-b51f-d7b125ae5f19 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:40.649965 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-8da73343-dabf-4333-b51f-d7b125ae5f19 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:40.650383 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-8da73343-dabf-4333-b51f-d7b125ae5f19 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:40.785228 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-8da73343-dabf-4333-b51f-d7b125ae5f19 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:40.793626 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-8da73343-dabf-4333-b51f-d7b125ae5f19 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:40.795173 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-8da73343-dabf-4333-b51f-d7b125ae5f19 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:40.796379 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-8da73343-dabf-4333-b51f-d7b125ae5f19 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1806 microversion: 2.20 time: 0.159092 Aug 09 07:05:40.796938 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 239/479] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:05:40 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1806 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:05:41.820594 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-9aa00c6b-d59c-4610-b754-bc03cac8728b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:41.821212 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-9aa00c6b-d59c-4610-b754-bc03cac8728b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:41.827861 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9aa00c6b-d59c-4610-b754-bc03cac8728b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:41.828346 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9aa00c6b-d59c-4610-b754-bc03cac8728b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:41.828819 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9aa00c6b-d59c-4610-b754-bc03cac8728b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:41.829506 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9aa00c6b-d59c-4610-b754-bc03cac8728b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:41.829979 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9aa00c6b-d59c-4610-b754-bc03cac8728b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:41.830386 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9aa00c6b-d59c-4610-b754-bc03cac8728b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:41.957758 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-9aa00c6b-d59c-4610-b754-bc03cac8728b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:41.966989 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-9aa00c6b-d59c-4610-b754-bc03cac8728b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:41.968520 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-9aa00c6b-d59c-4610-b754-bc03cac8728b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:41.969674 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-9aa00c6b-d59c-4610-b754-bc03cac8728b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1806 microversion: 2.20 time: 0.153762 Aug 09 07:05:41.970225 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 241/480] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:05:41 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1806 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:05:42.676911 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [req-eab5d5db-1220-4039-863b-485ed588ceb3 req-f094b2a1-16ba-4d5d-81d4-ec39b878dd40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2236b6b2-39b4-4b81-bb86-006774babc2e", "name": "network-vif-plugged", "status": "completed", "tag": "ada64d06-0764-4487-9425-780bad419035"}]} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:05:42.688319 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-eab5d5db-1220-4039-863b-485ed588ceb3 req-f094b2a1-16ba-4d5d-81d4-ec39b878dd40 service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:42.689504 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-eab5d5db-1220-4039-863b-485ed588ceb3 req-f094b2a1-16ba-4d5d-81d4-ec39b878dd40 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:42.689942 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-eab5d5db-1220-4039-863b-485ed588ceb3 req-f094b2a1-16ba-4d5d-81d4-ec39b878dd40 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:42.701866 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.compute.server_external_events [req-eab5d5db-1220-4039-863b-485ed588ceb3 req-f094b2a1-16ba-4d5d-81d4-ec39b878dd40 service nova] Creating event network-vif-plugged:ada64d06-0764-4487-9425-780bad419035 for instance 2236b6b2-39b4-4b81-bb86-006774babc2e on hv-cinder-85251 Aug 09 07:05:42.706974 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [req-eab5d5db-1220-4039-863b-485ed588ceb3 req-f094b2a1-16ba-4d5d-81d4-ec39b878dd40 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033622 Aug 09 07:05:42.707769 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 240/481] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:05:42.992425 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-59d4e990-5d66-48f9-963c-490725039c44 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:42.993028 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-59d4e990-5d66-48f9-963c-490725039c44 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:42.999370 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-59d4e990-5d66-48f9-963c-490725039c44 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:42.999875 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-59d4e990-5d66-48f9-963c-490725039c44 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:43.000336 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-59d4e990-5d66-48f9-963c-490725039c44 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:43.001011 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-59d4e990-5d66-48f9-963c-490725039c44 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:43.001455 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-59d4e990-5d66-48f9-963c-490725039c44 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:43.001871 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-59d4e990-5d66-48f9-963c-490725039c44 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:43.134618 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-59d4e990-5d66-48f9-963c-490725039c44 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:43.143338 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-59d4e990-5d66-48f9-963c-490725039c44 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:43.144892 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-59d4e990-5d66-48f9-963c-490725039c44 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:43.146067 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-59d4e990-5d66-48f9-963c-490725039c44 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1806 microversion: 2.20 time: 0.157676 Aug 09 07:05:43.146624 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 242/482] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:05:42 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:05:44.170425 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-d924724e-60ae-4fe0-9119-1ce7adfe19bf tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:44.171120 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-d924724e-60ae-4fe0-9119-1ce7adfe19bf tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:44.177429 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d924724e-60ae-4fe0-9119-1ce7adfe19bf tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:44.177939 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d924724e-60ae-4fe0-9119-1ce7adfe19bf tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:44.179045 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d924724e-60ae-4fe0-9119-1ce7adfe19bf tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:44.180024 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d924724e-60ae-4fe0-9119-1ce7adfe19bf tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:44.180478 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d924724e-60ae-4fe0-9119-1ce7adfe19bf tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:44.180901 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d924724e-60ae-4fe0-9119-1ce7adfe19bf tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:44.308501 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-d924724e-60ae-4fe0-9119-1ce7adfe19bf tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:44.316741 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-d924724e-60ae-4fe0-9119-1ce7adfe19bf tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:44.318234 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-d924724e-60ae-4fe0-9119-1ce7adfe19bf tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:44.319412 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-d924724e-60ae-4fe0-9119-1ce7adfe19bf tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1806 microversion: 2.20 time: 0.153253 Aug 09 07:05:44.319993 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 241/483] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:05:44 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1806 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:05:45.341685 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6811a41f-01f6-444c-b3cf-979c77651b23 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:45.342352 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-6811a41f-01f6-444c-b3cf-979c77651b23 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:45.349461 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6811a41f-01f6-444c-b3cf-979c77651b23 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:45.349944 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6811a41f-01f6-444c-b3cf-979c77651b23 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:45.350385 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6811a41f-01f6-444c-b3cf-979c77651b23 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:45.351078 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6811a41f-01f6-444c-b3cf-979c77651b23 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:45.351534 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6811a41f-01f6-444c-b3cf-979c77651b23 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:45.351982 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6811a41f-01f6-444c-b3cf-979c77651b23 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:45.485404 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6811a41f-01f6-444c-b3cf-979c77651b23 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:45.495087 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6811a41f-01f6-444c-b3cf-979c77651b23 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:45.496693 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6811a41f-01f6-444c-b3cf-979c77651b23 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:45.497855 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-6811a41f-01f6-444c-b3cf-979c77651b23 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1806 microversion: 2.20 time: 0.160006 Aug 09 07:05:45.498402 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 243/484] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:05:45 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:05:46.521227 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-0c90b87b-7d15-407d-8817-1d9fd4a61465 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:46.521830 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-0c90b87b-7d15-407d-8817-1d9fd4a61465 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:46.528700 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0c90b87b-7d15-407d-8817-1d9fd4a61465 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:46.529170 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0c90b87b-7d15-407d-8817-1d9fd4a61465 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:46.529597 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0c90b87b-7d15-407d-8817-1d9fd4a61465 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:46.530270 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0c90b87b-7d15-407d-8817-1d9fd4a61465 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:46.530715 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0c90b87b-7d15-407d-8817-1d9fd4a61465 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:46.531131 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0c90b87b-7d15-407d-8817-1d9fd4a61465 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:46.662052 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-0c90b87b-7d15-407d-8817-1d9fd4a61465 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:46.665097 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:05:46.674559 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-0c90b87b-7d15-407d-8817-1d9fd4a61465 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:46.676316 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-0c90b87b-7d15-407d-8817-1d9fd4a61465 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:46.677562 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-0c90b87b-7d15-407d-8817-1d9fd4a61465 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1793 microversion: 2.20 time: 0.160263 Aug 09 07:05:46.678275 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 242/485] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:05:46 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1793 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:05:50.689696 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-79f0673d-130e-4713-bcb2-8362e2fdad6d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:50.690265 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-79f0673d-130e-4713-bcb2-8362e2fdad6d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: f5e9e5b3-58c6-44f2-940a-c72b15dfd8db] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:50.696642 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-79f0673d-130e-4713-bcb2-8362e2fdad6d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:50.697115 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-79f0673d-130e-4713-bcb2-8362e2fdad6d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:50.697549 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-79f0673d-130e-4713-bcb2-8362e2fdad6d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:50.698226 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-79f0673d-130e-4713-bcb2-8362e2fdad6d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:50.698671 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-79f0673d-130e-4713-bcb2-8362e2fdad6d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:50.699089 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-79f0673d-130e-4713-bcb2-8362e2fdad6d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:50.701493 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:05:50.722872 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-79f0673d-130e-4713-bcb2-8362e2fdad6d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/f5e9e5b3-58c6-44f2-940a-c72b15dfd8db/ips" status: 200 len: 150 microversion: 2.1 time: 0.036997 Aug 09 07:05:50.723490 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 244/486] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Aug 9 07:05:50 2022] GET /compute/v2.1/servers/f5e9e5b3-58c6-44f2-940a-c72b15dfd8db/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:05:50.735827 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-ba948bfd-b0fd-4462-b99d-30670b6b3383 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "658e3261-9b74-4d8a-977b-770abed75cbb"}} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:05:50.738200 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-ba948bfd-b0fd-4462-b99d-30670b6b3383 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: f5e9e5b3-58c6-44f2-940a-c72b15dfd8db] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:50.740111 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_api:SELECT=26 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:05:50.746866 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ba948bfd-b0fd-4462-b99d-30670b6b3383 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:50.747343 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ba948bfd-b0fd-4462-b99d-30670b6b3383 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:50.747812 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ba948bfd-b0fd-4462-b99d-30670b6b3383 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:50.748504 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ba948bfd-b0fd-4462-b99d-30670b6b3383 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:50.748957 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ba948bfd-b0fd-4462-b99d-30670b6b3383 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:50.749378 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ba948bfd-b0fd-4462-b99d-30670b6b3383 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:50.827761 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.wsgi [None req-ba948bfd-b0fd-4462-b99d-30670b6b3383 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] HTTP exception thrown: Invalid volume: volume 658e3261-9b74-4d8a-977b-770abed75cbb is already attached to instances: 66d40f73-633e-4564-a6d4-732cd15dcb12 Aug 09 07:05:50.829469 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-ba948bfd-b0fd-4462-b99d-30670b6b3383 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Request method failure captured: Aug 09 07:05:50.829469 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: request: POST /compute/v2.1/servers/f5e9e5b3-58c6-44f2-940a-c72b15dfd8db/os-volume_attachments HTTP/1.1 Aug 09 07:05:50.829469 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Accept: application/json Aug 09 07:05:50.829469 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Accept-Encoding: identity Aug 09 07:05:50.829469 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Connection: close Aug 09 07:05:50.829469 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Content-Length: 74 Aug 09 07:05:50.829469 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Content-Type: application/json Aug 09 07:05:50.829469 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Host: 10.222.0.30 Aug 09 07:05:50.829469 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Openstack-System-Scope: None Aug 09 07:05:50.829469 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: User-Agent: python-urllib3/1.26.11 Aug 09 07:05:50.829469 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Auth-Token: gAAAAABi8gaG96fR8jlKQ8TiHSUILZSO2wcQMYr69tPNs3VsPdBbduE5q2N89Qfor1fKdUNuu3cU5AkFy4zL1QPl7jYp6fw9XYg8hg0IW6MscBdP4L-HtUgUgXdSQOw3p3as0Mug0wzwISkStMEUz2JvWC4HKwrWVHwt0TNvR0CveB6NheFq7RI Aug 09 07:05:50.829469 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Domain-Id: None Aug 09 07:05:50.829469 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Domain-Name: None Aug 09 07:05:50.829469 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Identity-Status: Confirmed Aug 09 07:05:50.829469 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Is-Admin-Project: True Aug 09 07:05:50.829469 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Domain-Id: default Aug 09 07:05:50.829469 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Domain-Name: Default Aug 09 07:05:50.829469 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Id: f38c6aa37b9643bbbe5bb7fd3efde4fd Aug 09 07:05:50.829469 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Name: tempest-AttachVolumeNegativeTest-2082484098 Aug 09 07:05:50.829469 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Role: reader,member Aug 09 07:05:50.829469 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Roles: reader,member Aug 09 07:05:50.831002 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f38c6aa37b9643bbbe5bb7fd3efde4fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f38c6aa37b9643bbbe5bb7fd3efde4fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f38c6aa37b9643bbbe5bb7fd3efde4fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f38c6aa37b9643bbbe5bb7fd3efde4fd"}]}] Aug 09 07:05:50.831002 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant: tempest-AttachVolumeNegativeTest-2082484098 Aug 09 07:05:50.831002 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant-Id: f38c6aa37b9643bbbe5bb7fd3efde4fd Aug 09 07:05:50.831002 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2082484098 Aug 09 07:05:50.831002 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User: tempest-AttachVolumeNegativeTest-2082484098-project Aug 09 07:05:50.831002 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Domain-Id: default Aug 09 07:05:50.831002 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Domain-Name: Default Aug 09 07:05:50.831002 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Id: cc885026afe041cca086367bb67d8a9b Aug 09 07:05:50.831002 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Name: tempest-AttachVolumeNegativeTest-2082484098-project Aug 09 07:05:50.831002 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Aug 09 07:05:50.831002 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: {"volumeAttachment": {"volumeId": "658e3261-9b74-4d8a-977b-770abed75cbb"}} Aug 09 07:05:50.831002 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: method: > Aug 09 07:05:50.831972 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: exception: Invalid volume: volume 658e3261-9b74-4d8a-977b-770abed75cbb is already attached to instances: 66d40f73-633e-4564-a6d4-732cd15dcb12 Aug 09 07:05:50.831972 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: action_args: {'server_id': 'f5e9e5b3-58c6-44f2-940a-c72b15dfd8db', 'body': {'volumeAttachment': {'volumeId': '658e3261-9b74-4d8a-977b-770abed75cbb'}}} Aug 09 07:05:50.831972 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 07:05:50.831972 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:05:50.831972 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 09 07:05:50.831972 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 09 07:05:50.831972 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 07:05:50.831972 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 07:05:50.831972 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 09 07:05:50.831972 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 07:05:50.831972 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 09 07:05:50.831972 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 09 07:05:50.831972 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 09 07:05:50.831972 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 09 07:05:50.831972 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 658e3261-9b74-4d8a-977b-770abed75cbb is already attached to instances: 66d40f73-633e-4564-a6d4-732cd15dcb12 Aug 09 07:05:50.831972 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:05:50.831972 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:05:50.831972 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:05:50.831972 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:05:50.833430 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:05:50.833430 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:05:50.833430 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 07:05:50.833430 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 07:05:50.833430 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 07:05:50.833430 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 07:05:50.833430 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 07:05:50.833430 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 07:05:50.833430 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 07:05:50.833430 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 07:05:50.833430 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 07:05:50.833430 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 07:05:50.833430 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 09 07:05:50.833430 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 09 07:05:50.833430 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 658e3261-9b74-4d8a-977b-770abed75cbb is already attached to instances: 66d40f73-633e-4564-a6d4-732cd15dcb12 Aug 09 07:05:50.833430 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:05:50.833430 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:05:50.833430 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:05:50.833430 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:05:50.833430 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:05:50.834883 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:05:50.834883 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 07:05:50.834883 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 07:05:50.834883 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 658e3261-9b74-4d8a-977b-770abed75cbb is already attached to instances: 66d40f73-633e-4564-a6d4-732cd15dcb12 Aug 09 07:05:50.834883 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:05:50.834883 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-ba948bfd-b0fd-4462-b99d-30670b6b3383 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Returning 400 to user: Invalid volume: volume 658e3261-9b74-4d8a-977b-770abed75cbb is already attached to instances: 66d40f73-633e-4564-a6d4-732cd15dcb12 {{(pid=117858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 07:05:50.834883 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-ba948bfd-b0fd-4462-b99d-30670b6b3383 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "POST /compute/v2.1/servers/f5e9e5b3-58c6-44f2-940a-c72b15dfd8db/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099404 Aug 09 07:05:50.834883 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 243/487] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Aug 9 07:05:50 2022] POST /compute/v2.1/servers/f5e9e5b3-58c6-44f2-940a-c72b15dfd8db/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 07:05:50.841814 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-fb2633fc-31af-405f-9dfa-596d87adb077 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:50.842299 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-fb2633fc-31af-405f-9dfa-596d87adb077 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: f5e9e5b3-58c6-44f2-940a-c72b15dfd8db] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:50.848420 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fb2633fc-31af-405f-9dfa-596d87adb077 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:50.848904 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fb2633fc-31af-405f-9dfa-596d87adb077 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:50.849338 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fb2633fc-31af-405f-9dfa-596d87adb077 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:50.850016 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fb2633fc-31af-405f-9dfa-596d87adb077 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:50.850466 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fb2633fc-31af-405f-9dfa-596d87adb077 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:50.850886 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fb2633fc-31af-405f-9dfa-596d87adb077 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:50.875262 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-fb2633fc-31af-405f-9dfa-596d87adb077 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: f5e9e5b3-58c6-44f2-940a-c72b15dfd8db] Going to try to terminate instance {{(pid=117859) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 07:05:50.949884 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-fb2633fc-31af-405f-9dfa-596d87adb077 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f5e9e5b3-58c6-44f2-940a-c72b15dfd8db" status: 204 len: 0 microversion: 2.1 time: 0.111466 Aug 09 07:05:50.950476 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 245/488] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 9 07:05:50 2022] DELETE /compute/v2.1/servers/f5e9e5b3-58c6-44f2-940a-c72b15dfd8db => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 07:05:50.959007 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-016af8c8-12a9-407b-a7e7-85ec7094cd43 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:50.959915 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-016af8c8-12a9-407b-a7e7-85ec7094cd43 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: f5e9e5b3-58c6-44f2-940a-c72b15dfd8db] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:50.967838 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-016af8c8-12a9-407b-a7e7-85ec7094cd43 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:50.968321 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-016af8c8-12a9-407b-a7e7-85ec7094cd43 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:50.968755 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-016af8c8-12a9-407b-a7e7-85ec7094cd43 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:50.969477 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-016af8c8-12a9-407b-a7e7-85ec7094cd43 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:50.969934 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-016af8c8-12a9-407b-a7e7-85ec7094cd43 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:50.970367 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-016af8c8-12a9-407b-a7e7-85ec7094cd43 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:51.099283 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-016af8c8-12a9-407b-a7e7-85ec7094cd43 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:51.106836 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-016af8c8-12a9-407b-a7e7-85ec7094cd43 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/f5e9e5b3-58c6-44f2-940a-c72b15dfd8db" status: 200 len: 1682 microversion: 2.1 time: 0.152090 Aug 09 07:05:51.107391 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 244/489] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:05:50 2022] GET /compute/v2.1/servers/f5e9e5b3-58c6-44f2-940a-c72b15dfd8db => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:05:52.130460 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b2cd9f06-2788-4c48-be57-67c65cbfcb22 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:52.131074 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b2cd9f06-2788-4c48-be57-67c65cbfcb22 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: f5e9e5b3-58c6-44f2-940a-c72b15dfd8db] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:52.139034 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b2cd9f06-2788-4c48-be57-67c65cbfcb22 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:52.139509 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b2cd9f06-2788-4c48-be57-67c65cbfcb22 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:52.139967 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b2cd9f06-2788-4c48-be57-67c65cbfcb22 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:52.140646 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b2cd9f06-2788-4c48-be57-67c65cbfcb22 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:52.141094 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b2cd9f06-2788-4c48-be57-67c65cbfcb22 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:52.141509 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b2cd9f06-2788-4c48-be57-67c65cbfcb22 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:52.275016 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b2cd9f06-2788-4c48-be57-67c65cbfcb22 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:52.282408 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b2cd9f06-2788-4c48-be57-67c65cbfcb22 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/f5e9e5b3-58c6-44f2-940a-c72b15dfd8db" status: 200 len: 1682 microversion: 2.1 time: 0.156503 Aug 09 07:05:52.282967 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 246/490] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:05:52 2022] GET /compute/v2.1/servers/f5e9e5b3-58c6-44f2-940a-c72b15dfd8db => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:05:53.177362 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-6a4f3f23-f9cc-4f05-92b3-06761c702391 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3249df34-5152-4d22-9b99-9b04ffa27706"}} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:05:53.180666 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-6a4f3f23-f9cc-4f05-92b3-06761c702391 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 51b65dde-1fef-4daa-9475-7609ac03dbc3] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:53.187873 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6a4f3f23-f9cc-4f05-92b3-06761c702391 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:53.188727 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6a4f3f23-f9cc-4f05-92b3-06761c702391 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:53.189520 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6a4f3f23-f9cc-4f05-92b3-06761c702391 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:53.190817 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6a4f3f23-f9cc-4f05-92b3-06761c702391 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:53.191660 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6a4f3f23-f9cc-4f05-92b3-06761c702391 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:53.192423 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6a4f3f23-f9cc-4f05-92b3-06761c702391 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:53.303676 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f54c87a0-c124-4f77-a7af-8be5c8f1a14a tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:53.305316 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-f54c87a0-c124-4f77-a7af-8be5c8f1a14a tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: f5e9e5b3-58c6-44f2-940a-c72b15dfd8db] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:53.311752 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f54c87a0-c124-4f77-a7af-8be5c8f1a14a tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:53.312238 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f54c87a0-c124-4f77-a7af-8be5c8f1a14a tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:53.312667 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f54c87a0-c124-4f77-a7af-8be5c8f1a14a tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:53.313357 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f54c87a0-c124-4f77-a7af-8be5c8f1a14a tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:53.313809 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f54c87a0-c124-4f77-a7af-8be5c8f1a14a tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:53.314235 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f54c87a0-c124-4f77-a7af-8be5c8f1a14a tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:53.385163 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-f54c87a0-c124-4f77-a7af-8be5c8f1a14a tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:05:53.393401 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f54c87a0-c124-4f77-a7af-8be5c8f1a14a tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/f5e9e5b3-58c6-44f2-940a-c72b15dfd8db" status: 200 len: 1614 microversion: 2.1 time: 0.093541 Aug 09 07:05:53.394488 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 247/491] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:05:53 2022] GET /compute/v2.1/servers/f5e9e5b3-58c6-44f2-940a-c72b15dfd8db => generated 1614 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:05:53.472911 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-eec61c5d-facf-47f7-bb8b-2f283fd6fa1b req-9875cb58-0bfb-4325-9e93-11e009fd0fec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5e9e5b3-58c6-44f2-940a-c72b15dfd8db", "name": "network-vif-deleted", "tag": "5e9f9cbf-0095-475f-a9eb-f3868a00ac39"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:05:53.485404 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-eec61c5d-facf-47f7-bb8b-2f283fd6fa1b req-9875cb58-0bfb-4325-9e93-11e009fd0fec service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:53.486175 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-eec61c5d-facf-47f7-bb8b-2f283fd6fa1b req-9875cb58-0bfb-4325-9e93-11e009fd0fec service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:53.486775 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-eec61c5d-facf-47f7-bb8b-2f283fd6fa1b req-9875cb58-0bfb-4325-9e93-11e009fd0fec service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:53.511273 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-eec61c5d-facf-47f7-bb8b-2f283fd6fa1b req-9875cb58-0bfb-4325-9e93-11e009fd0fec service nova] Creating event network-vif-deleted:5e9f9cbf-0095-475f-a9eb-f3868a00ac39 for instance f5e9e5b3-58c6-44f2-940a-c72b15dfd8db on hv-cinder-85251 Aug 09 07:05:53.516713 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-eec61c5d-facf-47f7-bb8b-2f283fd6fa1b req-9875cb58-0bfb-4325-9e93-11e009fd0fec service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047701 Aug 09 07:05:53.517312 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 248/492] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 07:05:53.539881 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-6a4f3f23-f9cc-4f05-92b3-06761c702391 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "POST /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.364369 Aug 09 07:05:53.541549 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 245/493] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Aug 9 07:05:53 2022] POST /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3/os-volume_attachments => generated 194 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 07:05:54.415573 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f6556a3c-d562-49fa-8927-f9af56a23183 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:54.416462 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-f6556a3c-d562-49fa-8927-f9af56a23183 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: f5e9e5b3-58c6-44f2-940a-c72b15dfd8db] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:54.423011 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f6556a3c-d562-49fa-8927-f9af56a23183 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:54.423822 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f6556a3c-d562-49fa-8927-f9af56a23183 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:54.424351 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f6556a3c-d562-49fa-8927-f9af56a23183 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:54.425206 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f6556a3c-d562-49fa-8927-f9af56a23183 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:54.425753 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f6556a3c-d562-49fa-8927-f9af56a23183 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:54.426277 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f6556a3c-d562-49fa-8927-f9af56a23183 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:54.443492 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-f6556a3c-d562-49fa-8927-f9af56a23183 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] HTTP exception thrown: Instance f5e9e5b3-58c6-44f2-940a-c72b15dfd8db could not be found. Aug 09 07:05:54.445816 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f6556a3c-d562-49fa-8927-f9af56a23183 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Request method failure captured: Aug 09 07:05:54.445816 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/f5e9e5b3-58c6-44f2-940a-c72b15dfd8db HTTP/1.1 Aug 09 07:05:54.445816 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 09 07:05:54.445816 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 09 07:05:54.445816 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Connection: close Aug 09 07:05:54.445816 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Length: 0 Aug 09 07:05:54.445816 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 09 07:05:54.445816 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.30 Aug 09 07:05:54.445816 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 09 07:05:54.445816 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.11 Aug 09 07:05:54.445816 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi8gaG96fR8jlKQ8TiHSUILZSO2wcQMYr69tPNs3VsPdBbduE5q2N89Qfor1fKdUNuu3cU5AkFy4zL1QPl7jYp6fw9XYg8hg0IW6MscBdP4L-HtUgUgXdSQOw3p3as0Mug0wzwISkStMEUz2JvWC4HKwrWVHwt0TNvR0CveB6NheFq7RI Aug 09 07:05:54.445816 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 09 07:05:54.445816 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 09 07:05:54.445816 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 09 07:05:54.445816 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 09 07:05:54.445816 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 09 07:05:54.445816 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 09 07:05:54.445816 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Id: f38c6aa37b9643bbbe5bb7fd3efde4fd Aug 09 07:05:54.445816 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-AttachVolumeNegativeTest-2082484098 Aug 09 07:05:54.445816 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 09 07:05:54.445816 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 09 07:05:54.447335 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f38c6aa37b9643bbbe5bb7fd3efde4fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f38c6aa37b9643bbbe5bb7fd3efde4fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f38c6aa37b9643bbbe5bb7fd3efde4fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f38c6aa37b9643bbbe5bb7fd3efde4fd"}]}] Aug 09 07:05:54.447335 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-AttachVolumeNegativeTest-2082484098 Aug 09 07:05:54.447335 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: f38c6aa37b9643bbbe5bb7fd3efde4fd Aug 09 07:05:54.447335 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2082484098 Aug 09 07:05:54.447335 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User: tempest-AttachVolumeNegativeTest-2082484098-project Aug 09 07:05:54.447335 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 09 07:05:54.447335 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 09 07:05:54.447335 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Id: cc885026afe041cca086367bb67d8a9b Aug 09 07:05:54.447335 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-AttachVolumeNegativeTest-2082484098-project Aug 09 07:05:54.447335 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: method: > Aug 09 07:05:54.447335 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: exception: Instance f5e9e5b3-58c6-44f2-940a-c72b15dfd8db could not be found. Aug 09 07:05:54.447335 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: action_args: {'id': 'f5e9e5b3-58c6-44f2-940a-c72b15dfd8db'} Aug 09 07:05:54.448360 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 07:05:54.448360 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:05:54.448360 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 07:05:54.448360 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 07:05:54.448360 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 07:05:54.448360 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 07:05:54.448360 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 07:05:54.448360 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 07:05:54.448360 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 07:05:54.448360 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 07:05:54.448360 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5e9e5b3-58c6-44f2-940a-c72b15dfd8db could not be found. Aug 09 07:05:54.448360 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:05:54.448360 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:05:54.448360 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:05:54.448360 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:05:54.448360 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:05:54.448360 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:05:54.448360 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 07:05:54.448360 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 07:05:54.448360 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 07:05:54.449570 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 07:05:54.449570 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 07:05:54.449570 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 07:05:54.449570 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 07:05:54.449570 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 07:05:54.449570 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 07:05:54.449570 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 07:05:54.449570 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5e9e5b3-58c6-44f2-940a-c72b15dfd8db could not be found. Aug 09 07:05:54.449570 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:05:54.449570 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:05:54.449570 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:05:54.449570 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:05:54.449570 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:05:54.449570 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:05:54.449570 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 07:05:54.449570 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 07:05:54.449570 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5e9e5b3-58c6-44f2-940a-c72b15dfd8db could not be found. Aug 09 07:05:54.449570 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:05:54.450610 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f6556a3c-d562-49fa-8927-f9af56a23183 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Returning 404 to user: Instance f5e9e5b3-58c6-44f2-940a-c72b15dfd8db could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 07:05:54.450610 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f6556a3c-d562-49fa-8927-f9af56a23183 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/f5e9e5b3-58c6-44f2-940a-c72b15dfd8db" status: 404 len: 111 microversion: 2.1 time: 0.037578 Aug 09 07:05:54.450610 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 249/494] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:05:54 2022] GET /compute/v2.1/servers/f5e9e5b3-58c6-44f2-940a-c72b15dfd8db => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 07:05:54.458702 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-abba5db1-0541-4c6f-a89f-7776462ea7c1 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '.version_select at 0x7f20ddd15430>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:54.481735 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-abba5db1-0541-4c6f-a89f-7776462ea7c1 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1195850535" status: 202 len: 0 microversion: 2.1 time: 0.027845 Aug 09 07:05:54.482349 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 246/495] 10.222.0.30 () {58 vars in 1221 bytes} [Tue Aug 9 07:05:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1195850535 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 07:05:55.186037 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-af7e5b6c-90f1-4f86-b649-19127ad1ec0f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:55.186532 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-af7e5b6c-90f1-4f86-b649-19127ad1ec0f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: 66d40f73-633e-4564-a6d4-732cd15dcb12] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:55.192615 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-af7e5b6c-90f1-4f86-b649-19127ad1ec0f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:55.193094 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-af7e5b6c-90f1-4f86-b649-19127ad1ec0f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:55.193532 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-af7e5b6c-90f1-4f86-b649-19127ad1ec0f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:55.194218 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-af7e5b6c-90f1-4f86-b649-19127ad1ec0f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:55.194826 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-af7e5b6c-90f1-4f86-b649-19127ad1ec0f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:55.195281 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-af7e5b6c-90f1-4f86-b649-19127ad1ec0f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:55.317356 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.objects.instance [None req-af7e5b6c-90f1-4f86-b649-19127ad1ec0f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lazy-loading 'services' on Instance uuid 66d40f73-633e-4564-a6d4-732cd15dcb12 {{(pid=117859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 07:05:55.428369 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-af7e5b6c-90f1-4f86-b649-19127ad1ec0f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "DELETE /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12/os-volume_attachments/658e3261-9b74-4d8a-977b-770abed75cbb" status: 202 len: 0 microversion: 2.1 time: 0.246035 Aug 09 07:05:55.429714 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 250/496] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Aug 9 07:05:55 2022] DELETE /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12/os-volume_attachments/658e3261-9b74-4d8a-977b-770abed75cbb => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 07:05:55.438127 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-59f5fbc1-8270-4c5b-bbb2-310b2f1edccb tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:55.440433 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-59f5fbc1-8270-4c5b-bbb2-310b2f1edccb tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: 66d40f73-633e-4564-a6d4-732cd15dcb12] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:55.448088 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-59f5fbc1-8270-4c5b-bbb2-310b2f1edccb tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:55.448590 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-59f5fbc1-8270-4c5b-bbb2-310b2f1edccb tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:55.449015 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-59f5fbc1-8270-4c5b-bbb2-310b2f1edccb tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:55.449719 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-59f5fbc1-8270-4c5b-bbb2-310b2f1edccb tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:55.450180 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-59f5fbc1-8270-4c5b-bbb2-310b2f1edccb tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:55.450599 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-59f5fbc1-8270-4c5b-bbb2-310b2f1edccb tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:55.480153 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-59f5fbc1-8270-4c5b-bbb2-310b2f1edccb tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046042 Aug 09 07:05:55.480873 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 247/497] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 9 07:05:55 2022] GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:05:56.493711 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-9acee6eb-f060-4736-943e-e009f8825414 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:56.496012 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-9acee6eb-f060-4736-943e-e009f8825414 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: 66d40f73-633e-4564-a6d4-732cd15dcb12] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:56.503076 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9acee6eb-f060-4736-943e-e009f8825414 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:56.503831 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9acee6eb-f060-4736-943e-e009f8825414 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:56.504273 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9acee6eb-f060-4736-943e-e009f8825414 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:56.504959 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9acee6eb-f060-4736-943e-e009f8825414 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:56.505405 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9acee6eb-f060-4736-943e-e009f8825414 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:56.505825 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9acee6eb-f060-4736-943e-e009f8825414 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:56.534519 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-9acee6eb-f060-4736-943e-e009f8825414 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045736 Aug 09 07:05:56.535063 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 251/498] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 9 07:05:56 2022] GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:05:57.546631 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-ea0f2157-5bdb-49a6-97bf-147ff1bba0ec tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:57.548901 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-ea0f2157-5bdb-49a6-97bf-147ff1bba0ec tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: 66d40f73-633e-4564-a6d4-732cd15dcb12] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:57.555956 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ea0f2157-5bdb-49a6-97bf-147ff1bba0ec tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:57.556431 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ea0f2157-5bdb-49a6-97bf-147ff1bba0ec tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:57.556858 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ea0f2157-5bdb-49a6-97bf-147ff1bba0ec tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:57.557532 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ea0f2157-5bdb-49a6-97bf-147ff1bba0ec tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:57.557980 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ea0f2157-5bdb-49a6-97bf-147ff1bba0ec tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:57.558402 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ea0f2157-5bdb-49a6-97bf-147ff1bba0ec tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:57.586701 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-ea0f2157-5bdb-49a6-97bf-147ff1bba0ec tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044020 Aug 09 07:05:57.587252 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 248/499] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 9 07:05:57 2022] GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:05:58.341479 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-70abf6b9-bc95-4ec3-9df5-76303851e8e0 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:58.342004 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-70abf6b9-bc95-4ec3-9df5-76303851e8e0 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:58.344332 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:05:58.349684 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-70abf6b9-bc95-4ec3-9df5-76303851e8e0 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:58.350157 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-70abf6b9-bc95-4ec3-9df5-76303851e8e0 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:58.350582 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-70abf6b9-bc95-4ec3-9df5-76303851e8e0 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:58.351319 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-70abf6b9-bc95-4ec3-9df5-76303851e8e0 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:58.351941 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-70abf6b9-bc95-4ec3-9df5-76303851e8e0 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:58.352554 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-70abf6b9-bc95-4ec3-9df5-76303851e8e0 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:58.436633 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.objects.instance [None req-70abf6b9-bc95-4ec3-9df5-76303851e8e0 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lazy-loading 'services' on Instance uuid 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 {{(pid=117859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 07:05:58.507463 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-70abf6b9-bc95-4ec3-9df5-76303851e8e0 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46/os-volume_attachments/479f418a-2c46-4c4c-8875-683265e11153" status: 202 len: 0 microversion: 2.1 time: 0.170017 Aug 09 07:05:58.508089 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 252/500] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Aug 9 07:05:58 2022] DELETE /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46/os-volume_attachments/479f418a-2c46-4c4c-8875-683265e11153 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 07:05:58.598266 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-f1c8bb3d-a3f2-4db7-b092-ac21297cd930 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:58.600750 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-f1c8bb3d-a3f2-4db7-b092-ac21297cd930 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: 66d40f73-633e-4564-a6d4-732cd15dcb12] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:58.608635 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f1c8bb3d-a3f2-4db7-b092-ac21297cd930 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:58.608935 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f1c8bb3d-a3f2-4db7-b092-ac21297cd930 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:58.609441 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f1c8bb3d-a3f2-4db7-b092-ac21297cd930 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:58.610264 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f1c8bb3d-a3f2-4db7-b092-ac21297cd930 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:58.610780 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f1c8bb3d-a3f2-4db7-b092-ac21297cd930 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:58.611207 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f1c8bb3d-a3f2-4db7-b092-ac21297cd930 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:58.640562 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-f1c8bb3d-a3f2-4db7-b092-ac21297cd930 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046129 Aug 09 07:05:58.641107 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 249/501] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 9 07:05:58 2022] GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:05:59.654785 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-65a391c6-2eaa-483d-996f-7f85746a271b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:05:59.656972 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-65a391c6-2eaa-483d-996f-7f85746a271b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: 66d40f73-633e-4564-a6d4-732cd15dcb12] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:05:59.662999 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-65a391c6-2eaa-483d-996f-7f85746a271b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:59.663471 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-65a391c6-2eaa-483d-996f-7f85746a271b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:59.663939 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-65a391c6-2eaa-483d-996f-7f85746a271b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:59.664928 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-65a391c6-2eaa-483d-996f-7f85746a271b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:05:59.665381 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-65a391c6-2eaa-483d-996f-7f85746a271b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:05:59.665801 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-65a391c6-2eaa-483d-996f-7f85746a271b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:05:59.699104 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-65a391c6-2eaa-483d-996f-7f85746a271b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049192 Aug 09 07:05:59.699667 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 253/502] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 9 07:05:59 2022] GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:06:00.712499 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-3229b332-04b0-4788-86cc-3711c86c7a4c tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:00.714660 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-3229b332-04b0-4788-86cc-3711c86c7a4c tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: 66d40f73-633e-4564-a6d4-732cd15dcb12] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:00.721202 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3229b332-04b0-4788-86cc-3711c86c7a4c tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:00.721683 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3229b332-04b0-4788-86cc-3711c86c7a4c tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:00.722119 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3229b332-04b0-4788-86cc-3711c86c7a4c tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:00.722812 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3229b332-04b0-4788-86cc-3711c86c7a4c tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:00.723263 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3229b332-04b0-4788-86cc-3711c86c7a4c tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:00.723714 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3229b332-04b0-4788-86cc-3711c86c7a4c tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:00.755209 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-3229b332-04b0-4788-86cc-3711c86c7a4c tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047384 Aug 09 07:06:00.755797 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 250/503] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 9 07:06:00 2022] GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:06:01.089441 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-60ab7188-3ae3-41e2-959c-daab2f2f4e27 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:06:01.091615 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-60ab7188-3ae3-41e2-959c-daab2f2f4e27 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 51b65dde-1fef-4daa-9475-7609ac03dbc3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:01.098096 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-60ab7188-3ae3-41e2-959c-daab2f2f4e27 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:01.098577 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-60ab7188-3ae3-41e2-959c-daab2f2f4e27 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:01.099010 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-60ab7188-3ae3-41e2-959c-daab2f2f4e27 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:01.099733 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-60ab7188-3ae3-41e2-959c-daab2f2f4e27 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:01.100194 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-60ab7188-3ae3-41e2-959c-daab2f2f4e27 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:01.100620 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-60ab7188-3ae3-41e2-959c-daab2f2f4e27 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:01.123729 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.objects.instance [None req-60ab7188-3ae3-41e2-959c-daab2f2f4e27 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lazy-loading 'flavor' on Instance uuid 51b65dde-1fef-4daa-9475-7609ac03dbc3 {{(pid=117859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 07:06:01.281555 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-60ab7188-3ae3-41e2-959c-daab2f2f4e27 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "POST /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3/action" status: 200 len: 32 microversion: 2.1 time: 0.196720 Aug 09 07:06:01.282217 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 254/504] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 9 07:06:01 2022] POST /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3/action => generated 32 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 07:06:01.291814 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-a389cf31-5db9-4d7b-ae55-b28a3a2469c3 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:01.292459 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-a389cf31-5db9-4d7b-ae55-b28a3a2469c3 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 51b65dde-1fef-4daa-9475-7609ac03dbc3] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:01.298544 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a389cf31-5db9-4d7b-ae55-b28a3a2469c3 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:01.299016 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a389cf31-5db9-4d7b-ae55-b28a3a2469c3 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:01.299449 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a389cf31-5db9-4d7b-ae55-b28a3a2469c3 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:01.300161 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a389cf31-5db9-4d7b-ae55-b28a3a2469c3 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:01.300611 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a389cf31-5db9-4d7b-ae55-b28a3a2469c3 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:01.301026 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a389cf31-5db9-4d7b-ae55-b28a3a2469c3 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:01.440683 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-a389cf31-5db9-4d7b-ae55-b28a3a2469c3 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:01.451241 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-a389cf31-5db9-4d7b-ae55-b28a3a2469c3 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3" status: 200 len: 1735 microversion: 2.1 time: 0.163493 Aug 09 07:06:01.451856 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 251/505] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:06:01 2022] GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:06:01.769263 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b9720b79-581e-4b15-bded-f1b602f77ec1 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:01.771535 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b9720b79-581e-4b15-bded-f1b602f77ec1 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: 66d40f73-633e-4564-a6d4-732cd15dcb12] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:01.777935 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b9720b79-581e-4b15-bded-f1b602f77ec1 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:01.778393 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b9720b79-581e-4b15-bded-f1b602f77ec1 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:01.778835 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b9720b79-581e-4b15-bded-f1b602f77ec1 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:01.779542 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b9720b79-581e-4b15-bded-f1b602f77ec1 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:01.780025 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b9720b79-581e-4b15-bded-f1b602f77ec1 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:01.780447 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b9720b79-581e-4b15-bded-f1b602f77ec1 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:01.811417 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b9720b79-581e-4b15-bded-f1b602f77ec1 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047806 Aug 09 07:06:01.812638 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 255/506] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 9 07:06:01 2022] GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 07:06:01.875098 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-118e6e02-9b5f-4305-91ec-79b7effb0f0b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:01.875609 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-118e6e02-9b5f-4305-91ec-79b7effb0f0b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: 66d40f73-633e-4564-a6d4-732cd15dcb12] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:01.882191 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-118e6e02-9b5f-4305-91ec-79b7effb0f0b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:01.882669 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-118e6e02-9b5f-4305-91ec-79b7effb0f0b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:01.883671 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-118e6e02-9b5f-4305-91ec-79b7effb0f0b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:01.884370 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-118e6e02-9b5f-4305-91ec-79b7effb0f0b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:01.884819 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-118e6e02-9b5f-4305-91ec-79b7effb0f0b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:01.885249 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-118e6e02-9b5f-4305-91ec-79b7effb0f0b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:01.912168 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-118e6e02-9b5f-4305-91ec-79b7effb0f0b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: 66d40f73-633e-4564-a6d4-732cd15dcb12] Going to try to terminate instance {{(pid=117858) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 07:06:01.995406 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-118e6e02-9b5f-4305-91ec-79b7effb0f0b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "DELETE /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12" status: 204 len: 0 microversion: 2.1 time: 0.123837 Aug 09 07:06:01.996027 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 252/507] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 9 07:06:01 2022] DELETE /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 07:06:02.004279 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-5a0d2d34-1239-4f1b-a51a-6afda46235cc tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:02.004894 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-5a0d2d34-1239-4f1b-a51a-6afda46235cc tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: 66d40f73-633e-4564-a6d4-732cd15dcb12] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:02.011408 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5a0d2d34-1239-4f1b-a51a-6afda46235cc tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:02.012007 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5a0d2d34-1239-4f1b-a51a-6afda46235cc tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:02.012989 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5a0d2d34-1239-4f1b-a51a-6afda46235cc tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:02.013694 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5a0d2d34-1239-4f1b-a51a-6afda46235cc tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:02.014187 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5a0d2d34-1239-4f1b-a51a-6afda46235cc tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:02.014611 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5a0d2d34-1239-4f1b-a51a-6afda46235cc tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:02.150045 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-5a0d2d34-1239-4f1b-a51a-6afda46235cc tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:02.157486 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-5a0d2d34-1239-4f1b-a51a-6afda46235cc tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12" status: 200 len: 1681 microversion: 2.1 time: 0.157256 Aug 09 07:06:02.158042 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 256/508] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:06:01 2022] GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:06:02.473847 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-13e0d301-c35c-4956-b469-58c94a0c2b14 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:02.474537 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-13e0d301-c35c-4956-b469-58c94a0c2b14 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 51b65dde-1fef-4daa-9475-7609ac03dbc3] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:02.480971 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-13e0d301-c35c-4956-b469-58c94a0c2b14 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:02.481448 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-13e0d301-c35c-4956-b469-58c94a0c2b14 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:02.481887 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-13e0d301-c35c-4956-b469-58c94a0c2b14 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:02.482564 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-13e0d301-c35c-4956-b469-58c94a0c2b14 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:02.483019 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-13e0d301-c35c-4956-b469-58c94a0c2b14 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:02.483438 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-13e0d301-c35c-4956-b469-58c94a0c2b14 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:02.612708 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-13e0d301-c35c-4956-b469-58c94a0c2b14 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:02.621009 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-13e0d301-c35c-4956-b469-58c94a0c2b14 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3" status: 200 len: 1735 microversion: 2.1 time: 0.151442 Aug 09 07:06:02.621678 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 253/509] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:06:02 2022] GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:06:02.806098 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-fed1e9a4-a8d2-4d32-9e4e-6993ddba6fd9 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:06:02.812206 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fed1e9a4-a8d2-4d32-9e4e-6993ddba6fd9 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:02.812677 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fed1e9a4-a8d2-4d32-9e4e-6993ddba6fd9 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:02.813111 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fed1e9a4-a8d2-4d32-9e4e-6993ddba6fd9 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:02.827148 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:06:02.837875 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-fed1e9a4-a8d2-4d32-9e4e-6993ddba6fd9 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Going to try to stop instance {{(pid=117859) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 09 07:06:02.879648 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-fed1e9a4-a8d2-4d32-9e4e-6993ddba6fd9 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "POST /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46/action" status: 202 len: 0 microversion: 2.1 time: 0.077587 Aug 09 07:06:02.880268 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 257/510] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 9 07:06:02 2022] POST /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 07:06:02.889268 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-061309bc-b59e-4ca6-b102-098a27218518 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:02.889880 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-061309bc-b59e-4ca6-b102-098a27218518 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:02.896171 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-061309bc-b59e-4ca6-b102-098a27218518 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:02.896650 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-061309bc-b59e-4ca6-b102-098a27218518 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:02.897081 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-061309bc-b59e-4ca6-b102-098a27218518 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:02.897764 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-061309bc-b59e-4ca6-b102-098a27218518 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:02.898216 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-061309bc-b59e-4ca6-b102-098a27218518 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:02.898689 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-061309bc-b59e-4ca6-b102-098a27218518 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:03.027025 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-061309bc-b59e-4ca6-b102-098a27218518 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:03.034428 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-061309bc-b59e-4ca6-b102-098a27218518 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1678 microversion: 2.1 time: 0.149003 Aug 09 07:06:03.035024 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 254/511] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:06:02 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:06:03.181321 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-bdf1eb87-160c-47bc-8221-4203b1f634f9 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:03.182023 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-bdf1eb87-160c-47bc-8221-4203b1f634f9 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: 66d40f73-633e-4564-a6d4-732cd15dcb12] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:03.189602 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bdf1eb87-160c-47bc-8221-4203b1f634f9 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:03.190265 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bdf1eb87-160c-47bc-8221-4203b1f634f9 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:03.190701 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bdf1eb87-160c-47bc-8221-4203b1f634f9 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:03.191390 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bdf1eb87-160c-47bc-8221-4203b1f634f9 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:03.191875 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bdf1eb87-160c-47bc-8221-4203b1f634f9 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:03.192294 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bdf1eb87-160c-47bc-8221-4203b1f634f9 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:03.325021 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-bdf1eb87-160c-47bc-8221-4203b1f634f9 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:03.332481 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-bdf1eb87-160c-47bc-8221-4203b1f634f9 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12" status: 200 len: 1681 microversion: 2.1 time: 0.156476 Aug 09 07:06:03.333052 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 258/512] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:06:03 2022] GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:06:03.643431 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-2d5aa12e-9cec-4b49-b076-8548597ad708 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:03.644092 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-2d5aa12e-9cec-4b49-b076-8548597ad708 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 51b65dde-1fef-4daa-9475-7609ac03dbc3] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:03.651193 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2d5aa12e-9cec-4b49-b076-8548597ad708 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:03.651722 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2d5aa12e-9cec-4b49-b076-8548597ad708 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:03.652154 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2d5aa12e-9cec-4b49-b076-8548597ad708 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:03.652835 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2d5aa12e-9cec-4b49-b076-8548597ad708 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:03.653284 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2d5aa12e-9cec-4b49-b076-8548597ad708 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:03.653701 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2d5aa12e-9cec-4b49-b076-8548597ad708 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:03.781240 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-2d5aa12e-9cec-4b49-b076-8548597ad708 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:03.789166 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-2d5aa12e-9cec-4b49-b076-8548597ad708 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3" status: 200 len: 1735 microversion: 2.1 time: 0.149647 Aug 09 07:06:03.795891 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 255/513] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:06:03 2022] GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:06:04.056265 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-3f80636d-80a6-4d2f-8c33-7e784851d75f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:04.056877 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-3f80636d-80a6-4d2f-8c33-7e784851d75f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:04.062771 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3f80636d-80a6-4d2f-8c33-7e784851d75f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:04.063261 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3f80636d-80a6-4d2f-8c33-7e784851d75f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:04.063774 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3f80636d-80a6-4d2f-8c33-7e784851d75f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:04.064468 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3f80636d-80a6-4d2f-8c33-7e784851d75f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:04.064924 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3f80636d-80a6-4d2f-8c33-7e784851d75f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:04.065351 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3f80636d-80a6-4d2f-8c33-7e784851d75f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:04.198596 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-3f80636d-80a6-4d2f-8c33-7e784851d75f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:04.206079 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-3f80636d-80a6-4d2f-8c33-7e784851d75f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1678 microversion: 2.1 time: 0.154371 Aug 09 07:06:04.206643 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 259/514] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:06:04 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:06:04.354434 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-feed5d17-34e2-4d3a-a338-8854fff2675f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:04.355047 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-feed5d17-34e2-4d3a-a338-8854fff2675f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: 66d40f73-633e-4564-a6d4-732cd15dcb12] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:04.361671 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-feed5d17-34e2-4d3a-a338-8854fff2675f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:04.362154 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-feed5d17-34e2-4d3a-a338-8854fff2675f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:04.362587 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-feed5d17-34e2-4d3a-a338-8854fff2675f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:04.363276 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-feed5d17-34e2-4d3a-a338-8854fff2675f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:04.363776 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-feed5d17-34e2-4d3a-a338-8854fff2675f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:04.364200 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-feed5d17-34e2-4d3a-a338-8854fff2675f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:04.426543 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-feed5d17-34e2-4d3a-a338-8854fff2675f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:04.434006 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-feed5d17-34e2-4d3a-a338-8854fff2675f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12" status: 200 len: 1613 microversion: 2.1 time: 0.084132 Aug 09 07:06:04.434572 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 256/515] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:06:04 2022] GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12 => generated 1613 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:06:04.585992 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-71ece334-02fa-4ef4-a75d-bfa4d17d14e9 req-dedac938-0f87-4180-9d0e-94492306dbb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66d40f73-633e-4564-a6d4-732cd15dcb12", "name": "network-vif-deleted", "tag": "6a17b65c-bc72-41ab-af44-8de8ed744b45"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:06:04.596185 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-71ece334-02fa-4ef4-a75d-bfa4d17d14e9 req-dedac938-0f87-4180-9d0e-94492306dbb7 service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:04.596654 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-71ece334-02fa-4ef4-a75d-bfa4d17d14e9 req-dedac938-0f87-4180-9d0e-94492306dbb7 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:04.597090 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-71ece334-02fa-4ef4-a75d-bfa4d17d14e9 req-dedac938-0f87-4180-9d0e-94492306dbb7 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:04.608208 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-71ece334-02fa-4ef4-a75d-bfa4d17d14e9 req-dedac938-0f87-4180-9d0e-94492306dbb7 service nova] Creating event network-vif-deleted:6a17b65c-bc72-41ab-af44-8de8ed744b45 for instance 66d40f73-633e-4564-a6d4-732cd15dcb12 on hv-cinder-85251 Aug 09 07:06:04.612860 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-71ece334-02fa-4ef4-a75d-bfa4d17d14e9 req-dedac938-0f87-4180-9d0e-94492306dbb7 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030581 Aug 09 07:06:04.613811 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 260/516] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:06:04.811399 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-da408cbe-d9f1-41cb-b36c-d2f2b4f7f31f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:04.812171 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-da408cbe-d9f1-41cb-b36c-d2f2b4f7f31f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 51b65dde-1fef-4daa-9475-7609ac03dbc3] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:04.818983 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-da408cbe-d9f1-41cb-b36c-d2f2b4f7f31f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:04.819462 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-da408cbe-d9f1-41cb-b36c-d2f2b4f7f31f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:04.819924 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-da408cbe-d9f1-41cb-b36c-d2f2b4f7f31f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:04.821284 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-da408cbe-d9f1-41cb-b36c-d2f2b4f7f31f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:04.821751 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-da408cbe-d9f1-41cb-b36c-d2f2b4f7f31f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:04.822174 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-da408cbe-d9f1-41cb-b36c-d2f2b4f7f31f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:04.837229 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:06:04.958001 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-da408cbe-d9f1-41cb-b36c-d2f2b4f7f31f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:04.966568 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-da408cbe-d9f1-41cb-b36c-d2f2b4f7f31f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3" status: 200 len: 1735 microversion: 2.1 time: 0.158947 Aug 09 07:06:04.967252 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 257/517] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:06:04 2022] GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:06:05.229360 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-61ddb16e-eb1b-4742-b40a-e9ac576ce1f5 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:05.229937 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-61ddb16e-eb1b-4742-b40a-e9ac576ce1f5 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:05.236293 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-61ddb16e-eb1b-4742-b40a-e9ac576ce1f5 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:05.236771 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-61ddb16e-eb1b-4742-b40a-e9ac576ce1f5 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:05.237198 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-61ddb16e-eb1b-4742-b40a-e9ac576ce1f5 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:05.237896 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-61ddb16e-eb1b-4742-b40a-e9ac576ce1f5 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:05.238342 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-61ddb16e-eb1b-4742-b40a-e9ac576ce1f5 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:05.238761 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-61ddb16e-eb1b-4742-b40a-e9ac576ce1f5 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:05.372600 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-61ddb16e-eb1b-4742-b40a-e9ac576ce1f5 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:05.380640 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-61ddb16e-eb1b-4742-b40a-e9ac576ce1f5 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1678 microversion: 2.1 time: 0.156650 Aug 09 07:06:05.381217 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 261/518] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:06:05 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:06:05.455871 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-5240a380-41f6-407d-876b-54b70bebb3c6 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:05.456369 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-5240a380-41f6-407d-876b-54b70bebb3c6 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: 66d40f73-633e-4564-a6d4-732cd15dcb12] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:05.463628 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5240a380-41f6-407d-876b-54b70bebb3c6 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:05.464140 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5240a380-41f6-407d-876b-54b70bebb3c6 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:05.464565 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5240a380-41f6-407d-876b-54b70bebb3c6 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:05.465270 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5240a380-41f6-407d-876b-54b70bebb3c6 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:05.465720 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5240a380-41f6-407d-876b-54b70bebb3c6 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:05.466147 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5240a380-41f6-407d-876b-54b70bebb3c6 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:05.481130 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.wsgi [None req-5240a380-41f6-407d-876b-54b70bebb3c6 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] HTTP exception thrown: Instance 66d40f73-633e-4564-a6d4-732cd15dcb12 could not be found. Aug 09 07:06:05.482777 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-5240a380-41f6-407d-876b-54b70bebb3c6 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Request method failure captured: Aug 09 07:06:05.482777 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: request: GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12 HTTP/1.1 Aug 09 07:06:05.482777 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Accept: application/json Aug 09 07:06:05.482777 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Accept-Encoding: identity Aug 09 07:06:05.482777 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Connection: close Aug 09 07:06:05.482777 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Content-Length: 0 Aug 09 07:06:05.482777 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Content-Type: application/json Aug 09 07:06:05.482777 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Host: 10.222.0.30 Aug 09 07:06:05.482777 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Openstack-System-Scope: None Aug 09 07:06:05.482777 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: User-Agent: python-urllib3/1.26.11 Aug 09 07:06:05.482777 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Auth-Token: gAAAAABi8gaG96fR8jlKQ8TiHSUILZSO2wcQMYr69tPNs3VsPdBbduE5q2N89Qfor1fKdUNuu3cU5AkFy4zL1QPl7jYp6fw9XYg8hg0IW6MscBdP4L-HtUgUgXdSQOw3p3as0Mug0wzwISkStMEUz2JvWC4HKwrWVHwt0TNvR0CveB6NheFq7RI Aug 09 07:06:05.482777 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Domain-Id: None Aug 09 07:06:05.482777 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Domain-Name: None Aug 09 07:06:05.482777 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Identity-Status: Confirmed Aug 09 07:06:05.482777 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Is-Admin-Project: True Aug 09 07:06:05.482777 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Domain-Id: default Aug 09 07:06:05.482777 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Domain-Name: Default Aug 09 07:06:05.482777 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Id: f38c6aa37b9643bbbe5bb7fd3efde4fd Aug 09 07:06:05.482777 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Name: tempest-AttachVolumeNegativeTest-2082484098 Aug 09 07:06:05.482777 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Role: reader,member Aug 09 07:06:05.482777 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Roles: reader,member Aug 09 07:06:05.484363 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f38c6aa37b9643bbbe5bb7fd3efde4fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f38c6aa37b9643bbbe5bb7fd3efde4fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f38c6aa37b9643bbbe5bb7fd3efde4fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f38c6aa37b9643bbbe5bb7fd3efde4fd"}]}] Aug 09 07:06:05.484363 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant: tempest-AttachVolumeNegativeTest-2082484098 Aug 09 07:06:05.484363 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant-Id: f38c6aa37b9643bbbe5bb7fd3efde4fd Aug 09 07:06:05.484363 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2082484098 Aug 09 07:06:05.484363 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User: tempest-AttachVolumeNegativeTest-2082484098-project Aug 09 07:06:05.484363 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Domain-Id: default Aug 09 07:06:05.484363 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Domain-Name: Default Aug 09 07:06:05.484363 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Id: cc885026afe041cca086367bb67d8a9b Aug 09 07:06:05.484363 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Name: tempest-AttachVolumeNegativeTest-2082484098-project Aug 09 07:06:05.484363 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: method: > Aug 09 07:06:05.484363 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: exception: Instance 66d40f73-633e-4564-a6d4-732cd15dcb12 could not be found. Aug 09 07:06:05.484363 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: action_args: {'id': '66d40f73-633e-4564-a6d4-732cd15dcb12'} Aug 09 07:06:05.485258 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 07:06:05.485258 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:06:05.485258 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 07:06:05.485258 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 07:06:05.485258 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 07:06:05.485258 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 07:06:05.485258 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 07:06:05.485258 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 07:06:05.485258 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 07:06:05.485258 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 07:06:05.485258 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66d40f73-633e-4564-a6d4-732cd15dcb12 could not be found. Aug 09 07:06:05.485258 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:06:05.485258 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:06:05.485258 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:06:05.485258 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:06:05.485258 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:06:05.485258 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:06:05.485258 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 07:06:05.485258 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 07:06:05.485258 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 07:06:05.486818 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 07:06:05.486818 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 07:06:05.486818 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 07:06:05.486818 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 07:06:05.486818 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 07:06:05.486818 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 07:06:05.486818 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 07:06:05.486818 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66d40f73-633e-4564-a6d4-732cd15dcb12 could not be found. Aug 09 07:06:05.486818 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:06:05.486818 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:06:05.486818 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:06:05.486818 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:06:05.486818 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:06:05.486818 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:06:05.486818 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 07:06:05.486818 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 07:06:05.486818 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66d40f73-633e-4564-a6d4-732cd15dcb12 could not be found. Aug 09 07:06:05.486818 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:06:05.488551 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-5240a380-41f6-407d-876b-54b70bebb3c6 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Returning 404 to user: Instance 66d40f73-633e-4564-a6d4-732cd15dcb12 could not be found. {{(pid=117858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 07:06:05.488551 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-5240a380-41f6-407d-876b-54b70bebb3c6 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12" status: 404 len: 111 microversion: 2.1 time: 0.032427 Aug 09 07:06:05.488551 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 258/519] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:06:05 2022] GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 07:06:05.493054 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4a3d36f7-57c6-494c-9776-6243739c9da3 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '.version_select at 0x7f20dd3b1430>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:05.513457 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4a3d36f7-57c6-494c-9776-6243739c9da3 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1359303097" status: 202 len: 0 microversion: 2.1 time: 0.024159 Aug 09 07:06:05.514045 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 262/520] 10.222.0.30 () {58 vars in 1221 bytes} [Tue Aug 9 07:06:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1359303097 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 07:06:05.988953 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-ec663dc2-fd5e-4473-a8bf-a6dcc02fd56d tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:05.989601 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-ec663dc2-fd5e-4473-a8bf-a6dcc02fd56d tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 51b65dde-1fef-4daa-9475-7609ac03dbc3] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:05.995500 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ec663dc2-fd5e-4473-a8bf-a6dcc02fd56d tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:05.996039 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ec663dc2-fd5e-4473-a8bf-a6dcc02fd56d tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:05.996479 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ec663dc2-fd5e-4473-a8bf-a6dcc02fd56d tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:05.997175 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ec663dc2-fd5e-4473-a8bf-a6dcc02fd56d tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:05.997631 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ec663dc2-fd5e-4473-a8bf-a6dcc02fd56d tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:05.998056 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ec663dc2-fd5e-4473-a8bf-a6dcc02fd56d tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:06.132771 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-ec663dc2-fd5e-4473-a8bf-a6dcc02fd56d tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:06.140990 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-ec663dc2-fd5e-4473-a8bf-a6dcc02fd56d tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3" status: 200 len: 1735 microversion: 2.1 time: 0.155887 Aug 09 07:06:06.141540 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 259/521] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:06:05 2022] GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:06:06.346588 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-8d208e0f-103f-4e04-87ef-36f05fa890ee tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Action: 'create', calling method: .version_select at 0x7f20dd4ce940>, body: {"keypair": {"name": "tempest-keypair-2093328113", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDxS00noBKL1PKpMeAaUJPN5/1PzpG1kDhvKNaFOalIomb+IJ68Nh334XSMTFijtOofIbs9wMHqwYuEXHRnSH03TMTd7j8e0e2cXnTzUFeCC9Lctp99dWY1LxughgxshYg=="}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:06:06.363543 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-8d208e0f-103f-4e04-87ef-36f05fa890ee tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Getting quotas for project f38c6aa37b9643bbbe5bb7fd3efde4fd. Resources: {'key_pairs'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 07:06:06.367336 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-8d208e0f-103f-4e04-87ef-36f05fa890ee tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Getting quotas for user cc885026afe041cca086367bb67d8a9b and project f38c6aa37b9643bbbe5bb7fd3efde4fd. Resources: {'key_pairs'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 07:06:06.389359 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-8d208e0f-103f-4e04-87ef-36f05fa890ee tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046617 Aug 09 07:06:06.389943 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 263/522] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 9 07:06:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:06:06.402654 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-892e8346-1fb0-4bc8-9df5-ae0d9ca0f8b7 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:06.403293 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-892e8346-1fb0-4bc8-9df5-ae0d9ca0f8b7 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:06.409195 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-892e8346-1fb0-4bc8-9df5-ae0d9ca0f8b7 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:06.409683 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-892e8346-1fb0-4bc8-9df5-ae0d9ca0f8b7 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:06.410120 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-892e8346-1fb0-4bc8-9df5-ae0d9ca0f8b7 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:06.410811 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-892e8346-1fb0-4bc8-9df5-ae0d9ca0f8b7 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:06.411267 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-892e8346-1fb0-4bc8-9df5-ae0d9ca0f8b7 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:06.411791 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-892e8346-1fb0-4bc8-9df5-ae0d9ca0f8b7 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:06.557237 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-892e8346-1fb0-4bc8-9df5-ae0d9ca0f8b7 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:06.566008 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-892e8346-1fb0-4bc8-9df5-ae0d9ca0f8b7 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1678 microversion: 2.1 time: 0.167786 Aug 09 07:06:06.566577 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 260/523] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:06:06 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:06:07.162755 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b3e1b8b9-3c2f-408b-82e5-b7d66d5cffd5 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:07.163366 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b3e1b8b9-3c2f-408b-82e5-b7d66d5cffd5 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 51b65dde-1fef-4daa-9475-7609ac03dbc3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:07.170138 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b3e1b8b9-3c2f-408b-82e5-b7d66d5cffd5 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:07.170611 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b3e1b8b9-3c2f-408b-82e5-b7d66d5cffd5 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:07.171038 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b3e1b8b9-3c2f-408b-82e5-b7d66d5cffd5 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:07.171755 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b3e1b8b9-3c2f-408b-82e5-b7d66d5cffd5 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:07.172200 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b3e1b8b9-3c2f-408b-82e5-b7d66d5cffd5 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:07.172624 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b3e1b8b9-3c2f-408b-82e5-b7d66d5cffd5 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:07.306393 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b3e1b8b9-3c2f-408b-82e5-b7d66d5cffd5 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:07.314328 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b3e1b8b9-3c2f-408b-82e5-b7d66d5cffd5 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3" status: 200 len: 1735 microversion: 2.1 time: 0.155575 Aug 09 07:06:07.315114 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 264/524] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:06:07 2022] GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:06:07.588485 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-cbe34bfd-753e-401b-b6fa-c4c32ace9155 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:07.589210 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-cbe34bfd-753e-401b-b6fa-c4c32ace9155 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:07.595808 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cbe34bfd-753e-401b-b6fa-c4c32ace9155 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:07.596297 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cbe34bfd-753e-401b-b6fa-c4c32ace9155 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:07.596738 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cbe34bfd-753e-401b-b6fa-c4c32ace9155 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:07.597435 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cbe34bfd-753e-401b-b6fa-c4c32ace9155 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:07.597895 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cbe34bfd-753e-401b-b6fa-c4c32ace9155 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:07.598321 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cbe34bfd-753e-401b-b6fa-c4c32ace9155 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:07.666056 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-5cbabe4c-7085-4380-a9b3-f22a95f1321e tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1840872306", "imageRef": "5d2c35cc-2f3b-4a22-bd68-79c71882b6a2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "20e6e819-0a94-455d-a88e-5217530385f8"}], "security_groups": [{"name": "tempest-securitygroup--1445453141"}], "key_name": "tempest-keypair-2093328113", "user_data": "}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:06:07.738693 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-cbe34bfd-753e-401b-b6fa-c4c32ace9155 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:07.747056 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-cbe34bfd-753e-401b-b6fa-c4c32ace9155 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1678 microversion: 2.1 time: 0.162904 Aug 09 07:06:07.758556 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 261/525] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:06:07 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:06:07.774583 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.network.neutron [None req-5cbabe4c-7085-4380-a9b3-f22a95f1321e tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] validate_networks() for [('20e6e819-0a94-455d-a88e-5217530385f8', None, None, None, None, None)] {{(pid=117859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 07:06:08.134443 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-5cbabe4c-7085-4380-a9b3-f22a95f1321e tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Flavor limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 07:06:08.134854 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-5cbabe4c-7085-4380-a9b3-f22a95f1321e tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Image limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 07:06:08.135351 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-5cbabe4c-7085-4380-a9b3-f22a95f1321e tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Flavor pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 07:06:08.135795 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-5cbabe4c-7085-4380-a9b3-f22a95f1321e tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Image pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 07:06:08.136198 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-5cbabe4c-7085-4380-a9b3-f22a95f1321e tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 07:06:08.145228 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5cbabe4c-7085-4380-a9b3-f22a95f1321e tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:08.145700 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5cbabe4c-7085-4380-a9b3-f22a95f1321e tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:08.146125 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5cbabe4c-7085-4380-a9b3-f22a95f1321e tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:08.146838 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5cbabe4c-7085-4380-a9b3-f22a95f1321e tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:08.147282 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5cbabe4c-7085-4380-a9b3-f22a95f1321e tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:08.147729 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5cbabe4c-7085-4380-a9b3-f22a95f1321e tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:08.165065 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-5cbabe4c-7085-4380-a9b3-f22a95f1321e tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Getting quotas for project f38c6aa37b9643bbbe5bb7fd3efde4fd. Resources: {'cores', 'instances', 'ram'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 07:06:08.169456 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-5cbabe4c-7085-4380-a9b3-f22a95f1321e tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Getting quotas for user cc885026afe041cca086367bb67d8a9b and project f38c6aa37b9643bbbe5bb7fd3efde4fd. Resources: {'cores', 'instances', 'ram'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 07:06:08.180977 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-5cbabe4c-7085-4380-a9b3-f22a95f1321e tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Going to run 1 instances... {{(pid=117859) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 07:06:08.183194 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-5cbabe4c-7085-4380-a9b3-f22a95f1321e tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: eb8f3b26-f937-4677-b8f9-9208f68a0449] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5d2c35cc-2f3b-4a22-bd68-79c71882b6a2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 07:06:08.228372 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-5cbabe4c-7085-4380-a9b3-f22a95f1321e tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.566868 Aug 09 07:06:08.229002 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 265/526] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 9 07:06:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 09 07:06:08.239937 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-f0d441dd-0c3c-4599-bd4a-fb7c1d131221 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:08.240563 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-f0d441dd-0c3c-4599-bd4a-fb7c1d131221 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: eb8f3b26-f937-4677-b8f9-9208f68a0449] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:08.294427 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-f0d441dd-0c3c-4599-bd4a-fb7c1d131221 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:08.300938 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-f0d441dd-0c3c-4599-bd4a-fb7c1d131221 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/eb8f3b26-f937-4677-b8f9-9208f68a0449" status: 200 len: 1242 microversion: 2.1 time: 0.064929 Aug 09 07:06:08.301491 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 262/527] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:06:08 2022] GET /compute/v2.1/servers/eb8f3b26-f937-4677-b8f9-9208f68a0449 => generated 1242 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:06:08.335416 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-966ba10d-e761-40f9-9e69-49d125fcb5da tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:08.336611 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-966ba10d-e761-40f9-9e69-49d125fcb5da tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 51b65dde-1fef-4daa-9475-7609ac03dbc3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:08.342814 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-966ba10d-e761-40f9-9e69-49d125fcb5da tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:08.343303 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-966ba10d-e761-40f9-9e69-49d125fcb5da tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:08.343768 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-966ba10d-e761-40f9-9e69-49d125fcb5da tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:08.344457 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-966ba10d-e761-40f9-9e69-49d125fcb5da tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:08.344912 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-966ba10d-e761-40f9-9e69-49d125fcb5da tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:08.345335 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-966ba10d-e761-40f9-9e69-49d125fcb5da tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:08.486184 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-966ba10d-e761-40f9-9e69-49d125fcb5da tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:08.494429 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-966ba10d-e761-40f9-9e69-49d125fcb5da tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3" status: 200 len: 1735 microversion: 2.1 time: 0.162956 Aug 09 07:06:08.494990 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 266/528] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:06:08 2022] GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:06:08.768875 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-4bd3aad4-4627-4062-ad04-fb1c17a7d591 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:08.769487 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-4bd3aad4-4627-4062-ad04-fb1c17a7d591 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:08.777388 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4bd3aad4-4627-4062-ad04-fb1c17a7d591 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:08.777959 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4bd3aad4-4627-4062-ad04-fb1c17a7d591 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:08.778492 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4bd3aad4-4627-4062-ad04-fb1c17a7d591 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:08.779257 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4bd3aad4-4627-4062-ad04-fb1c17a7d591 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:08.779748 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4bd3aad4-4627-4062-ad04-fb1c17a7d591 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:08.780176 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4bd3aad4-4627-4062-ad04-fb1c17a7d591 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:08.929524 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-4bd3aad4-4627-4062-ad04-fb1c17a7d591 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:08.937068 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-4bd3aad4-4627-4062-ad04-fb1c17a7d591 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1678 microversion: 2.1 time: 0.172012 Aug 09 07:06:08.937629 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 263/529] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:06:08 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1678 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:06:09.323079 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-097e30bc-d821-48bd-bb61-40e16844f65b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:09.323790 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-097e30bc-d821-48bd-bb61-40e16844f65b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: eb8f3b26-f937-4677-b8f9-9208f68a0449] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:09.331021 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-097e30bc-d821-48bd-bb61-40e16844f65b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:09.331829 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-097e30bc-d821-48bd-bb61-40e16844f65b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:09.332444 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-097e30bc-d821-48bd-bb61-40e16844f65b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:09.333317 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-097e30bc-d821-48bd-bb61-40e16844f65b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:09.334878 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-097e30bc-d821-48bd-bb61-40e16844f65b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:09.335314 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-097e30bc-d821-48bd-bb61-40e16844f65b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:09.408078 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-097e30bc-d821-48bd-bb61-40e16844f65b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:09.416179 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-097e30bc-d821-48bd-bb61-40e16844f65b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/eb8f3b26-f937-4677-b8f9-9208f68a0449" status: 200 len: 1300 microversion: 2.1 time: 0.098450 Aug 09 07:06:09.416744 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 267/530] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:06:09 2022] GET /compute/v2.1/servers/eb8f3b26-f937-4677-b8f9-9208f68a0449 => generated 1300 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:06:09.516228 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-6d396077-7eb1-41bc-98cd-517c560b3a17 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:09.516831 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-6d396077-7eb1-41bc-98cd-517c560b3a17 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 51b65dde-1fef-4daa-9475-7609ac03dbc3] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:09.522607 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6d396077-7eb1-41bc-98cd-517c560b3a17 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:09.523084 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6d396077-7eb1-41bc-98cd-517c560b3a17 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:09.523771 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6d396077-7eb1-41bc-98cd-517c560b3a17 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:09.524556 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6d396077-7eb1-41bc-98cd-517c560b3a17 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:09.525005 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6d396077-7eb1-41bc-98cd-517c560b3a17 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:09.525431 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6d396077-7eb1-41bc-98cd-517c560b3a17 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:09.657629 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-6d396077-7eb1-41bc-98cd-517c560b3a17 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:09.667422 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-6d396077-7eb1-41bc-98cd-517c560b3a17 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3" status: 200 len: 1735 microversion: 2.1 time: 0.155170 Aug 09 07:06:09.668360 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 264/531] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:06:09 2022] GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:06:09.958528 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-eed0fb19-eefa-45db-b7be-ebde266843ba tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:09.959265 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-eed0fb19-eefa-45db-b7be-ebde266843ba tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:09.966155 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-eed0fb19-eefa-45db-b7be-ebde266843ba tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:09.966973 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-eed0fb19-eefa-45db-b7be-ebde266843ba tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:09.967775 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-eed0fb19-eefa-45db-b7be-ebde266843ba tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:09.968594 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-eed0fb19-eefa-45db-b7be-ebde266843ba tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:09.969153 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-eed0fb19-eefa-45db-b7be-ebde266843ba tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:09.969679 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-eed0fb19-eefa-45db-b7be-ebde266843ba tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:10.109423 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-eed0fb19-eefa-45db-b7be-ebde266843ba tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:10.118498 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-eed0fb19-eefa-45db-b7be-ebde266843ba tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1678 microversion: 2.1 time: 0.163028 Aug 09 07:06:10.119100 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 268/532] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:06:09 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:06:10.437849 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-26d8c0a7-04cf-4a2b-a38b-a6a5bf64e347 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:10.438582 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-26d8c0a7-04cf-4a2b-a38b-a6a5bf64e347 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: eb8f3b26-f937-4677-b8f9-9208f68a0449] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:10.444709 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-26d8c0a7-04cf-4a2b-a38b-a6a5bf64e347 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:10.445765 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-26d8c0a7-04cf-4a2b-a38b-a6a5bf64e347 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:10.446325 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-26d8c0a7-04cf-4a2b-a38b-a6a5bf64e347 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:10.447183 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-26d8c0a7-04cf-4a2b-a38b-a6a5bf64e347 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:10.447660 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-26d8c0a7-04cf-4a2b-a38b-a6a5bf64e347 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:10.448086 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-26d8c0a7-04cf-4a2b-a38b-a6a5bf64e347 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:10.496910 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-1d1a1440-fe44-4948-8aac-6c835faccfff req-ee3c79f2-5691-45ba-bb51-d13ec7d5ab39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb8f3b26-f937-4677-b8f9-9208f68a0449", "tag": "9a48b6aa-872a-4373-8b0a-0da98fa36ff4"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:06:10.511223 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-1d1a1440-fe44-4948-8aac-6c835faccfff req-ee3c79f2-5691-45ba-bb51-d13ec7d5ab39 service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:10.512081 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-1d1a1440-fe44-4948-8aac-6c835faccfff req-ee3c79f2-5691-45ba-bb51-d13ec7d5ab39 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:10.512799 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-1d1a1440-fe44-4948-8aac-6c835faccfff req-ee3c79f2-5691-45ba-bb51-d13ec7d5ab39 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:10.526295 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-1d1a1440-fe44-4948-8aac-6c835faccfff req-ee3c79f2-5691-45ba-bb51-d13ec7d5ab39 service nova] Creating event network-changed:9a48b6aa-872a-4373-8b0a-0da98fa36ff4 for instance eb8f3b26-f937-4677-b8f9-9208f68a0449 on hv-cinder-85251 Aug 09 07:06:10.531554 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-1d1a1440-fe44-4948-8aac-6c835faccfff req-ee3c79f2-5691-45ba-bb51-d13ec7d5ab39 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038937 Aug 09 07:06:10.532368 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 269/533] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:06:10.604557 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-26d8c0a7-04cf-4a2b-a38b-a6a5bf64e347 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:10.612090 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-26d8c0a7-04cf-4a2b-a38b-a6a5bf64e347 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/eb8f3b26-f937-4677-b8f9-9208f68a0449" status: 200 len: 1368 microversion: 2.1 time: 0.178359 Aug 09 07:06:10.612656 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 265/534] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:06:10 2022] GET /compute/v2.1/servers/eb8f3b26-f937-4677-b8f9-9208f68a0449 => generated 1368 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:06:10.690258 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-7fe4ed87-cb16-4971-b250-183b1755ca70 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:10.690959 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-7fe4ed87-cb16-4971-b250-183b1755ca70 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 51b65dde-1fef-4daa-9475-7609ac03dbc3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:10.697918 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7fe4ed87-cb16-4971-b250-183b1755ca70 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:10.698428 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7fe4ed87-cb16-4971-b250-183b1755ca70 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:10.698852 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7fe4ed87-cb16-4971-b250-183b1755ca70 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:10.699555 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7fe4ed87-cb16-4971-b250-183b1755ca70 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:10.700396 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7fe4ed87-cb16-4971-b250-183b1755ca70 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:10.700500 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7fe4ed87-cb16-4971-b250-183b1755ca70 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:10.831648 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-7fe4ed87-cb16-4971-b250-183b1755ca70 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:10.840234 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-7fe4ed87-cb16-4971-b250-183b1755ca70 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3" status: 200 len: 1735 microversion: 2.1 time: 0.154220 Aug 09 07:06:10.841004 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 270/535] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:06:10 2022] GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:06:11.140857 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-a7fbe63b-fbed-4181-8422-2bcf125e0623 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:11.141465 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-a7fbe63b-fbed-4181-8422-2bcf125e0623 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:11.147384 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a7fbe63b-fbed-4181-8422-2bcf125e0623 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:11.147963 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a7fbe63b-fbed-4181-8422-2bcf125e0623 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:11.148442 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a7fbe63b-fbed-4181-8422-2bcf125e0623 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:11.149234 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a7fbe63b-fbed-4181-8422-2bcf125e0623 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:11.149689 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a7fbe63b-fbed-4181-8422-2bcf125e0623 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:11.150114 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a7fbe63b-fbed-4181-8422-2bcf125e0623 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:11.277254 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-a7fbe63b-fbed-4181-8422-2bcf125e0623 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:11.284987 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-a7fbe63b-fbed-4181-8422-2bcf125e0623 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1678 microversion: 2.1 time: 0.148211 Aug 09 07:06:11.285552 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 266/536] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:06:11 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:06:11.634874 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-fb999a1a-258c-45cc-a255-7b00379416f3 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:11.635421 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-fb999a1a-258c-45cc-a255-7b00379416f3 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: eb8f3b26-f937-4677-b8f9-9208f68a0449] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:11.641755 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fb999a1a-258c-45cc-a255-7b00379416f3 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:11.642231 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fb999a1a-258c-45cc-a255-7b00379416f3 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:11.642664 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fb999a1a-258c-45cc-a255-7b00379416f3 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:11.643348 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fb999a1a-258c-45cc-a255-7b00379416f3 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:11.643831 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fb999a1a-258c-45cc-a255-7b00379416f3 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:11.644253 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fb999a1a-258c-45cc-a255-7b00379416f3 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:11.776391 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-fb999a1a-258c-45cc-a255-7b00379416f3 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:11.783817 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-fb999a1a-258c-45cc-a255-7b00379416f3 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/eb8f3b26-f937-4677-b8f9-9208f68a0449" status: 200 len: 1368 microversion: 2.1 time: 0.153463 Aug 09 07:06:11.784381 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 271/537] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:06:11 2022] GET /compute/v2.1/servers/eb8f3b26-f937-4677-b8f9-9208f68a0449 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:06:11.864015 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-acd6a444-5647-43e5-8538-2e4a318fb47c tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:11.864547 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-acd6a444-5647-43e5-8538-2e4a318fb47c tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 51b65dde-1fef-4daa-9475-7609ac03dbc3] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:11.870834 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-acd6a444-5647-43e5-8538-2e4a318fb47c tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:11.871320 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-acd6a444-5647-43e5-8538-2e4a318fb47c tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:11.871790 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-acd6a444-5647-43e5-8538-2e4a318fb47c tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:11.872490 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-acd6a444-5647-43e5-8538-2e4a318fb47c tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:11.872949 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-acd6a444-5647-43e5-8538-2e4a318fb47c tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:11.873382 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-acd6a444-5647-43e5-8538-2e4a318fb47c tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:12.004001 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-acd6a444-5647-43e5-8538-2e4a318fb47c tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:12.012714 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-acd6a444-5647-43e5-8538-2e4a318fb47c tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3" status: 200 len: 1735 microversion: 2.1 time: 0.152571 Aug 09 07:06:12.013287 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 267/538] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:06:11 2022] GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:06:12.306713 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-64ce3342-e754-4988-80fa-683ce4700ad3 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:12.307344 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-64ce3342-e754-4988-80fa-683ce4700ad3 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:12.313258 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-64ce3342-e754-4988-80fa-683ce4700ad3 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:12.313743 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-64ce3342-e754-4988-80fa-683ce4700ad3 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:12.314181 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-64ce3342-e754-4988-80fa-683ce4700ad3 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:12.314866 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-64ce3342-e754-4988-80fa-683ce4700ad3 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:12.315322 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-64ce3342-e754-4988-80fa-683ce4700ad3 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:12.315783 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-64ce3342-e754-4988-80fa-683ce4700ad3 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:12.446584 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-64ce3342-e754-4988-80fa-683ce4700ad3 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:12.453970 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-64ce3342-e754-4988-80fa-683ce4700ad3 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1678 microversion: 2.1 time: 0.151636 Aug 09 07:06:12.454532 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 272/539] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:06:12 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:06:12.804321 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-ed95f8bd-64da-4bd0-a3f2-fdbfb8f865a4 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:12.805103 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-ed95f8bd-64da-4bd0-a3f2-fdbfb8f865a4 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: eb8f3b26-f937-4677-b8f9-9208f68a0449] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:12.811002 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ed95f8bd-64da-4bd0-a3f2-fdbfb8f865a4 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:12.811473 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ed95f8bd-64da-4bd0-a3f2-fdbfb8f865a4 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:12.811945 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ed95f8bd-64da-4bd0-a3f2-fdbfb8f865a4 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:12.812620 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ed95f8bd-64da-4bd0-a3f2-fdbfb8f865a4 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:12.813065 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ed95f8bd-64da-4bd0-a3f2-fdbfb8f865a4 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:12.813482 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ed95f8bd-64da-4bd0-a3f2-fdbfb8f865a4 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:12.943070 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-ed95f8bd-64da-4bd0-a3f2-fdbfb8f865a4 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:12.950372 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-ed95f8bd-64da-4bd0-a3f2-fdbfb8f865a4 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/eb8f3b26-f937-4677-b8f9-9208f68a0449" status: 200 len: 1368 microversion: 2.1 time: 0.149845 Aug 09 07:06:12.950933 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 268/540] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:06:12 2022] GET /compute/v2.1/servers/eb8f3b26-f937-4677-b8f9-9208f68a0449 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:06:13.033814 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-715a2ef5-00c3-433d-8534-99ddb5df92bb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:13.034345 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-715a2ef5-00c3-433d-8534-99ddb5df92bb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 51b65dde-1fef-4daa-9475-7609ac03dbc3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:13.041567 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-715a2ef5-00c3-433d-8534-99ddb5df92bb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:13.042045 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-715a2ef5-00c3-433d-8534-99ddb5df92bb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:13.042478 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-715a2ef5-00c3-433d-8534-99ddb5df92bb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:13.043167 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-715a2ef5-00c3-433d-8534-99ddb5df92bb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:13.043645 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-715a2ef5-00c3-433d-8534-99ddb5df92bb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:13.044076 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-715a2ef5-00c3-433d-8534-99ddb5df92bb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:13.170599 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-715a2ef5-00c3-433d-8534-99ddb5df92bb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:13.178819 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-715a2ef5-00c3-433d-8534-99ddb5df92bb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3" status: 200 len: 1735 microversion: 2.1 time: 0.148862 Aug 09 07:06:13.179462 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 273/541] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:06:13 2022] GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:06:13.475272 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-938ad778-6027-4924-9776-62aa9d646d0c tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:13.475921 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-938ad778-6027-4924-9776-62aa9d646d0c tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:13.481839 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-938ad778-6027-4924-9776-62aa9d646d0c tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:13.482327 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-938ad778-6027-4924-9776-62aa9d646d0c tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:13.482768 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-938ad778-6027-4924-9776-62aa9d646d0c tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:13.483457 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-938ad778-6027-4924-9776-62aa9d646d0c tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:13.483948 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-938ad778-6027-4924-9776-62aa9d646d0c tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:13.484375 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-938ad778-6027-4924-9776-62aa9d646d0c tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:13.614084 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-938ad778-6027-4924-9776-62aa9d646d0c tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:13.622286 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-938ad778-6027-4924-9776-62aa9d646d0c tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1678 microversion: 2.1 time: 0.150970 Aug 09 07:06:13.622858 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 269/542] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:06:13 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:06:13.971517 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-30677385-3589-4605-aa7e-d364236d28a4 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:13.972149 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-30677385-3589-4605-aa7e-d364236d28a4 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: eb8f3b26-f937-4677-b8f9-9208f68a0449] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:13.979141 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-30677385-3589-4605-aa7e-d364236d28a4 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:13.979638 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-30677385-3589-4605-aa7e-d364236d28a4 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:13.980074 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-30677385-3589-4605-aa7e-d364236d28a4 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:13.980753 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-30677385-3589-4605-aa7e-d364236d28a4 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:13.981198 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-30677385-3589-4605-aa7e-d364236d28a4 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:13.981615 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-30677385-3589-4605-aa7e-d364236d28a4 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:14.107403 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-30677385-3589-4605-aa7e-d364236d28a4 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:14.114810 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-30677385-3589-4605-aa7e-d364236d28a4 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/eb8f3b26-f937-4677-b8f9-9208f68a0449" status: 200 len: 1368 microversion: 2.1 time: 0.147048 Aug 09 07:06:14.115318 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 274/543] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:06:13 2022] GET /compute/v2.1/servers/eb8f3b26-f937-4677-b8f9-9208f68a0449 => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:06:14.200150 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-a55033e6-2c03-4a1d-8eff-de36c9c50ffb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:14.200758 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-a55033e6-2c03-4a1d-8eff-de36c9c50ffb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 51b65dde-1fef-4daa-9475-7609ac03dbc3] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:14.207054 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a55033e6-2c03-4a1d-8eff-de36c9c50ffb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:14.207531 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a55033e6-2c03-4a1d-8eff-de36c9c50ffb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:14.207998 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a55033e6-2c03-4a1d-8eff-de36c9c50ffb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:14.208677 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a55033e6-2c03-4a1d-8eff-de36c9c50ffb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:14.209124 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a55033e6-2c03-4a1d-8eff-de36c9c50ffb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:14.209542 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a55033e6-2c03-4a1d-8eff-de36c9c50ffb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:14.340842 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-a55033e6-2c03-4a1d-8eff-de36c9c50ffb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:14.348724 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-a55033e6-2c03-4a1d-8eff-de36c9c50ffb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3" status: 200 len: 1735 microversion: 2.1 time: 0.152390 Aug 09 07:06:14.349308 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 270/544] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:06:14 2022] GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:06:14.644711 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-70ac3865-3313-49f3-83fd-6f344d6b79f3 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:14.645351 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-70ac3865-3313-49f3-83fd-6f344d6b79f3 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:14.652196 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-70ac3865-3313-49f3-83fd-6f344d6b79f3 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:14.652674 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-70ac3865-3313-49f3-83fd-6f344d6b79f3 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:14.653105 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-70ac3865-3313-49f3-83fd-6f344d6b79f3 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:14.653791 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-70ac3865-3313-49f3-83fd-6f344d6b79f3 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:14.654235 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-70ac3865-3313-49f3-83fd-6f344d6b79f3 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:14.654654 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-70ac3865-3313-49f3-83fd-6f344d6b79f3 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:14.783091 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-70ac3865-3313-49f3-83fd-6f344d6b79f3 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:14.791278 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-70ac3865-3313-49f3-83fd-6f344d6b79f3 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1655 microversion: 2.1 time: 0.150624 Aug 09 07:06:14.791899 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 275/545] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:06:14 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1655 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:06:14.813957 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-bd6cf544-8aa3-4c96-bc94-4c29875b0025 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:06:14.819865 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-bd6cf544-8aa3-4c96-bc94-4c29875b0025 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:14.820482 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-bd6cf544-8aa3-4c96-bc94-4c29875b0025 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:14.821107 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-bd6cf544-8aa3-4c96-bc94-4c29875b0025 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:14.882090 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-bd6cf544-8aa3-4c96-bc94-4c29875b0025 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Going to try to start instance {{(pid=117858) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 09 07:06:14.923581 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-bd6cf544-8aa3-4c96-bc94-4c29875b0025 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "POST /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46/action" status: 202 len: 0 microversion: 2.1 time: 0.113280 Aug 09 07:06:14.924291 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 271/546] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 9 07:06:14 2022] POST /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 07:06:14.933169 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2b9c7bc2-ff87-4c58-b0c7-3cb851db73f6 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:14.933785 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-2b9c7bc2-ff87-4c58-b0c7-3cb851db73f6 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:14.939739 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2b9c7bc2-ff87-4c58-b0c7-3cb851db73f6 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:14.940223 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2b9c7bc2-ff87-4c58-b0c7-3cb851db73f6 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:14.940656 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2b9c7bc2-ff87-4c58-b0c7-3cb851db73f6 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:14.941342 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2b9c7bc2-ff87-4c58-b0c7-3cb851db73f6 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:14.941793 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2b9c7bc2-ff87-4c58-b0c7-3cb851db73f6 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:14.942216 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2b9c7bc2-ff87-4c58-b0c7-3cb851db73f6 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:15.087946 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2b9c7bc2-ff87-4c58-b0c7-3cb851db73f6 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:15.096139 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-2b9c7bc2-ff87-4c58-b0c7-3cb851db73f6 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1664 microversion: 2.1 time: 0.167572 Aug 09 07:06:15.099863 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 276/547] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:06:14 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1664 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:06:15.136720 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-d33577cd-4b78-4a78-a300-45d2b6b0ec71 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:15.137321 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-d33577cd-4b78-4a78-a300-45d2b6b0ec71 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: eb8f3b26-f937-4677-b8f9-9208f68a0449] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:15.143571 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d33577cd-4b78-4a78-a300-45d2b6b0ec71 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:15.144282 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d33577cd-4b78-4a78-a300-45d2b6b0ec71 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:15.144726 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d33577cd-4b78-4a78-a300-45d2b6b0ec71 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:15.145435 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d33577cd-4b78-4a78-a300-45d2b6b0ec71 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:15.145895 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d33577cd-4b78-4a78-a300-45d2b6b0ec71 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:15.146615 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d33577cd-4b78-4a78-a300-45d2b6b0ec71 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:15.281902 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-d33577cd-4b78-4a78-a300-45d2b6b0ec71 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:15.289651 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-d33577cd-4b78-4a78-a300-45d2b6b0ec71 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/eb8f3b26-f937-4677-b8f9-9208f68a0449" status: 200 len: 1368 microversion: 2.1 time: 0.157095 Aug 09 07:06:15.290235 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 272/548] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:06:15 2022] GET /compute/v2.1/servers/eb8f3b26-f937-4677-b8f9-9208f68a0449 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:06:15.370989 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-5ea355a0-1cf8-4815-aca9-ea02b2c51b2f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:15.371627 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-5ea355a0-1cf8-4815-aca9-ea02b2c51b2f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 51b65dde-1fef-4daa-9475-7609ac03dbc3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:15.377536 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5ea355a0-1cf8-4815-aca9-ea02b2c51b2f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:15.378016 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5ea355a0-1cf8-4815-aca9-ea02b2c51b2f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:15.378704 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5ea355a0-1cf8-4815-aca9-ea02b2c51b2f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:15.379386 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5ea355a0-1cf8-4815-aca9-ea02b2c51b2f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:15.379871 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5ea355a0-1cf8-4815-aca9-ea02b2c51b2f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:15.380295 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5ea355a0-1cf8-4815-aca9-ea02b2c51b2f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:15.384748 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:06:15.512245 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-5ea355a0-1cf8-4815-aca9-ea02b2c51b2f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:15.520078 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-5ea355a0-1cf8-4815-aca9-ea02b2c51b2f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3" status: 200 len: 1735 microversion: 2.1 time: 0.153667 Aug 09 07:06:15.520639 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 277/549] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:06:15 2022] GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:06:16.118265 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-50290f3a-30d2-43cc-96f7-4c896d8e771f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:16.118794 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-50290f3a-30d2-43cc-96f7-4c896d8e771f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:16.124692 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-50290f3a-30d2-43cc-96f7-4c896d8e771f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:16.125177 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-50290f3a-30d2-43cc-96f7-4c896d8e771f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:16.125608 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-50290f3a-30d2-43cc-96f7-4c896d8e771f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:16.126294 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-50290f3a-30d2-43cc-96f7-4c896d8e771f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:16.126747 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-50290f3a-30d2-43cc-96f7-4c896d8e771f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:16.127169 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-50290f3a-30d2-43cc-96f7-4c896d8e771f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:16.258526 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-50290f3a-30d2-43cc-96f7-4c896d8e771f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:16.265887 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-50290f3a-30d2-43cc-96f7-4c896d8e771f tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1668 microversion: 2.1 time: 0.151530 Aug 09 07:06:16.266440 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 273/550] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:06:16 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1668 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:06:16.316300 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-0b4e0397-07e0-464f-bdcb-47049d62dfe3 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:16.316941 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-0b4e0397-07e0-464f-bdcb-47049d62dfe3 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: eb8f3b26-f937-4677-b8f9-9208f68a0449] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:16.323995 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0b4e0397-07e0-464f-bdcb-47049d62dfe3 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:16.324476 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0b4e0397-07e0-464f-bdcb-47049d62dfe3 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:16.324916 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0b4e0397-07e0-464f-bdcb-47049d62dfe3 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:16.325610 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0b4e0397-07e0-464f-bdcb-47049d62dfe3 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:16.326065 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0b4e0397-07e0-464f-bdcb-47049d62dfe3 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:16.326489 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0b4e0397-07e0-464f-bdcb-47049d62dfe3 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:16.454374 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-0b4e0397-07e0-464f-bdcb-47049d62dfe3 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:16.462795 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-0b4e0397-07e0-464f-bdcb-47049d62dfe3 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/eb8f3b26-f937-4677-b8f9-9208f68a0449" status: 200 len: 1368 microversion: 2.1 time: 0.150320 Aug 09 07:06:16.463364 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 278/551] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:06:16 2022] GET /compute/v2.1/servers/eb8f3b26-f937-4677-b8f9-9208f68a0449 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:06:16.541217 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-4a2d5ab2-4be2-49ea-9f23-0b6e842f43be tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:16.541832 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-4a2d5ab2-4be2-49ea-9f23-0b6e842f43be tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 51b65dde-1fef-4daa-9475-7609ac03dbc3] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:16.547719 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4a2d5ab2-4be2-49ea-9f23-0b6e842f43be tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:16.548201 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4a2d5ab2-4be2-49ea-9f23-0b6e842f43be tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:16.548640 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4a2d5ab2-4be2-49ea-9f23-0b6e842f43be tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:16.549328 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4a2d5ab2-4be2-49ea-9f23-0b6e842f43be tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:16.549779 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4a2d5ab2-4be2-49ea-9f23-0b6e842f43be tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:16.550205 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4a2d5ab2-4be2-49ea-9f23-0b6e842f43be tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:16.683740 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-4a2d5ab2-4be2-49ea-9f23-0b6e842f43be tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:16.686449 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:06:16.694022 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-4a2d5ab2-4be2-49ea-9f23-0b6e842f43be tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3" status: 200 len: 1735 microversion: 2.1 time: 0.156695 Aug 09 07:06:16.694700 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 274/552] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:06:16 2022] GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:06:16.787307 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-202534de-bcdf-4801-a9b9-b73e9b7e372a req-63ee6ace-0d9b-43da-b5ac-effac3945f3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb8f3b26-f937-4677-b8f9-9208f68a0449", "name": "network-vif-plugged", "status": "completed", "tag": "9a48b6aa-872a-4373-8b0a-0da98fa36ff4"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:06:16.798416 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-202534de-bcdf-4801-a9b9-b73e9b7e372a req-63ee6ace-0d9b-43da-b5ac-effac3945f3e service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:16.798905 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-202534de-bcdf-4801-a9b9-b73e9b7e372a req-63ee6ace-0d9b-43da-b5ac-effac3945f3e service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:16.799400 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-202534de-bcdf-4801-a9b9-b73e9b7e372a req-63ee6ace-0d9b-43da-b5ac-effac3945f3e service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:16.812991 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-202534de-bcdf-4801-a9b9-b73e9b7e372a req-63ee6ace-0d9b-43da-b5ac-effac3945f3e service nova] Creating event network-vif-plugged:9a48b6aa-872a-4373-8b0a-0da98fa36ff4 for instance eb8f3b26-f937-4677-b8f9-9208f68a0449 on hv-cinder-85251 Aug 09 07:06:16.818386 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-202534de-bcdf-4801-a9b9-b73e9b7e372a req-63ee6ace-0d9b-43da-b5ac-effac3945f3e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034779 Aug 09 07:06:16.818989 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 279/553] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:06:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 07:06:17.483270 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-a92da0fb-9044-4292-ba6b-e9be687cc01b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:17.483921 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-a92da0fb-9044-4292-ba6b-e9be687cc01b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: eb8f3b26-f937-4677-b8f9-9208f68a0449] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:17.490999 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a92da0fb-9044-4292-ba6b-e9be687cc01b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:17.491476 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a92da0fb-9044-4292-ba6b-e9be687cc01b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:17.491982 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a92da0fb-9044-4292-ba6b-e9be687cc01b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:17.492615 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a92da0fb-9044-4292-ba6b-e9be687cc01b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:17.493065 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a92da0fb-9044-4292-ba6b-e9be687cc01b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:17.493485 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a92da0fb-9044-4292-ba6b-e9be687cc01b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:17.624797 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-a92da0fb-9044-4292-ba6b-e9be687cc01b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:17.633009 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-a92da0fb-9044-4292-ba6b-e9be687cc01b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/eb8f3b26-f937-4677-b8f9-9208f68a0449" status: 200 len: 1368 microversion: 2.1 time: 0.153235 Aug 09 07:06:17.633566 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 275/554] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:06:17 2022] GET /compute/v2.1/servers/eb8f3b26-f937-4677-b8f9-9208f68a0449 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:06:17.717580 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c8b9a2f8-0798-447c-98e1-4c636a489a6c tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:17.718275 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c8b9a2f8-0798-447c-98e1-4c636a489a6c tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 51b65dde-1fef-4daa-9475-7609ac03dbc3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:17.724325 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c8b9a2f8-0798-447c-98e1-4c636a489a6c tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:17.724799 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c8b9a2f8-0798-447c-98e1-4c636a489a6c tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:17.725228 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c8b9a2f8-0798-447c-98e1-4c636a489a6c tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:17.725910 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c8b9a2f8-0798-447c-98e1-4c636a489a6c tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:17.726846 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c8b9a2f8-0798-447c-98e1-4c636a489a6c tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:17.727272 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c8b9a2f8-0798-447c-98e1-4c636a489a6c tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:17.857919 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c8b9a2f8-0798-447c-98e1-4c636a489a6c tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:17.865905 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c8b9a2f8-0798-447c-98e1-4c636a489a6c tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3" status: 200 len: 1735 microversion: 2.1 time: 0.153008 Aug 09 07:06:17.866470 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 280/555] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:06:17 2022] GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:06:18.653718 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-39d308cc-249c-416c-83b8-7bdc531320ad tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:18.654918 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-39d308cc-249c-416c-83b8-7bdc531320ad tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: eb8f3b26-f937-4677-b8f9-9208f68a0449] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:18.656890 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_cell0:SELECT=2 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:06:18.662992 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-39d308cc-249c-416c-83b8-7bdc531320ad tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:18.663568 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-39d308cc-249c-416c-83b8-7bdc531320ad tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:18.664030 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-39d308cc-249c-416c-83b8-7bdc531320ad tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:18.664749 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-39d308cc-249c-416c-83b8-7bdc531320ad tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:18.665188 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-39d308cc-249c-416c-83b8-7bdc531320ad tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:18.665608 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-39d308cc-249c-416c-83b8-7bdc531320ad tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:18.805622 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-39d308cc-249c-416c-83b8-7bdc531320ad tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:18.813149 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-39d308cc-249c-416c-83b8-7bdc531320ad tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/eb8f3b26-f937-4677-b8f9-9208f68a0449" status: 200 len: 1368 microversion: 2.1 time: 0.163478 Aug 09 07:06:18.813710 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 276/556] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:06:18 2022] GET /compute/v2.1/servers/eb8f3b26-f937-4677-b8f9-9208f68a0449 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:06:18.888881 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-553a44dc-9d7a-4f6e-8f50-3ad37a48d883 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:18.889490 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-553a44dc-9d7a-4f6e-8f50-3ad37a48d883 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 51b65dde-1fef-4daa-9475-7609ac03dbc3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:18.891401 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=2 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:06:18.892152 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=10 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:06:18.898728 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-553a44dc-9d7a-4f6e-8f50-3ad37a48d883 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:18.899207 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-553a44dc-9d7a-4f6e-8f50-3ad37a48d883 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:18.899673 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-553a44dc-9d7a-4f6e-8f50-3ad37a48d883 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:18.900364 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-553a44dc-9d7a-4f6e-8f50-3ad37a48d883 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:18.900815 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-553a44dc-9d7a-4f6e-8f50-3ad37a48d883 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:18.901237 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-553a44dc-9d7a-4f6e-8f50-3ad37a48d883 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:19.041188 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-553a44dc-9d7a-4f6e-8f50-3ad37a48d883 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:19.056907 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-553a44dc-9d7a-4f6e-8f50-3ad37a48d883 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3" status: 200 len: 1735 microversion: 2.1 time: 0.171550 Aug 09 07:06:19.057856 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 281/557] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:06:18 2022] GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:06:19.834420 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-be2396e9-af5c-4bae-b8f6-a0b7e63e83e9 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:19.835022 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-be2396e9-af5c-4bae-b8f6-a0b7e63e83e9 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: eb8f3b26-f937-4677-b8f9-9208f68a0449] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:19.841573 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-be2396e9-af5c-4bae-b8f6-a0b7e63e83e9 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:19.842052 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-be2396e9-af5c-4bae-b8f6-a0b7e63e83e9 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:19.842479 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-be2396e9-af5c-4bae-b8f6-a0b7e63e83e9 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:19.843155 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-be2396e9-af5c-4bae-b8f6-a0b7e63e83e9 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:19.843626 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-be2396e9-af5c-4bae-b8f6-a0b7e63e83e9 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:19.844042 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-be2396e9-af5c-4bae-b8f6-a0b7e63e83e9 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:19.974419 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-be2396e9-af5c-4bae-b8f6-a0b7e63e83e9 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:19.982617 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-be2396e9-af5c-4bae-b8f6-a0b7e63e83e9 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/eb8f3b26-f937-4677-b8f9-9208f68a0449" status: 200 len: 1558 microversion: 2.1 time: 0.152168 Aug 09 07:06:19.983214 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 277/558] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:06:19 2022] GET /compute/v2.1/servers/eb8f3b26-f937-4677-b8f9-9208f68a0449 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:06:20.003223 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-85e80120-aa32-454d-ae29-fdbd658e5b42 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:20.003993 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-85e80120-aa32-454d-ae29-fdbd658e5b42 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: eb8f3b26-f937-4677-b8f9-9208f68a0449] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:20.010530 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-85e80120-aa32-454d-ae29-fdbd658e5b42 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:20.011006 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-85e80120-aa32-454d-ae29-fdbd658e5b42 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:20.011444 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-85e80120-aa32-454d-ae29-fdbd658e5b42 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:20.012178 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-85e80120-aa32-454d-ae29-fdbd658e5b42 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:20.012635 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-85e80120-aa32-454d-ae29-fdbd658e5b42 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:20.013060 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-85e80120-aa32-454d-ae29-fdbd658e5b42 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:20.080568 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-8a9f7623-6cde-4263-93fb-b713689c6e0c tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:20.081192 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-8a9f7623-6cde-4263-93fb-b713689c6e0c tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 51b65dde-1fef-4daa-9475-7609ac03dbc3] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:20.087286 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-8a9f7623-6cde-4263-93fb-b713689c6e0c tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:20.087840 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-8a9f7623-6cde-4263-93fb-b713689c6e0c tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:20.088219 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-8a9f7623-6cde-4263-93fb-b713689c6e0c tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:20.088913 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-8a9f7623-6cde-4263-93fb-b713689c6e0c tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:20.089361 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-8a9f7623-6cde-4263-93fb-b713689c6e0c tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:20.089783 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-8a9f7623-6cde-4263-93fb-b713689c6e0c tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:20.090143 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-85e80120-aa32-454d-ae29-fdbd658e5b42 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/eb8f3b26-f937-4677-b8f9-9208f68a0449/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090670 Aug 09 07:06:20.090838 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 282/559] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Aug 9 07:06:19 2022] GET /compute/v2.1/servers/eb8f3b26-f937-4677-b8f9-9208f68a0449/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:06:20.364720 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-8a9f7623-6cde-4263-93fb-b713689c6e0c tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:20.372869 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-8a9f7623-6cde-4263-93fb-b713689c6e0c tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3" status: 200 len: 1735 microversion: 2.1 time: 0.296276 Aug 09 07:06:20.374262 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 278/560] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:06:20 2022] GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3 => generated 1735 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:06:21.322235 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-eafa4202-7feb-40d4-bfce-953d5beae00f req-ff85d5a8-0c96-4c18-a7ba-eb2b0c375e0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb8f3b26-f937-4677-b8f9-9208f68a0449", "tag": "9a48b6aa-872a-4373-8b0a-0da98fa36ff4"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:06:21.331638 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-eafa4202-7feb-40d4-bfce-953d5beae00f req-ff85d5a8-0c96-4c18-a7ba-eb2b0c375e0d service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:21.332119 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-eafa4202-7feb-40d4-bfce-953d5beae00f req-ff85d5a8-0c96-4c18-a7ba-eb2b0c375e0d service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:21.332554 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-eafa4202-7feb-40d4-bfce-953d5beae00f req-ff85d5a8-0c96-4c18-a7ba-eb2b0c375e0d service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:21.344160 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-eafa4202-7feb-40d4-bfce-953d5beae00f req-ff85d5a8-0c96-4c18-a7ba-eb2b0c375e0d service nova] Creating event network-changed:9a48b6aa-872a-4373-8b0a-0da98fa36ff4 for instance eb8f3b26-f937-4677-b8f9-9208f68a0449 on hv-cinder-85251 Aug 09 07:06:21.348969 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-eafa4202-7feb-40d4-bfce-953d5beae00f req-ff85d5a8-0c96-4c18-a7ba-eb2b0c375e0d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030926 Aug 09 07:06:21.349569 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 283/561] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:06:21.394403 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-3e2d08fc-6866-4407-907a-bd899ff03176 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:21.395284 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-3e2d08fc-6866-4407-907a-bd899ff03176 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 51b65dde-1fef-4daa-9475-7609ac03dbc3] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:21.397958 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:06:21.404821 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3e2d08fc-6866-4407-907a-bd899ff03176 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:21.406428 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3e2d08fc-6866-4407-907a-bd899ff03176 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:21.407320 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3e2d08fc-6866-4407-907a-bd899ff03176 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:21.407702 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3e2d08fc-6866-4407-907a-bd899ff03176 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:21.408161 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3e2d08fc-6866-4407-907a-bd899ff03176 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:21.408587 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3e2d08fc-6866-4407-907a-bd899ff03176 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:21.544832 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-3e2d08fc-6866-4407-907a-bd899ff03176 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:21.553287 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-3e2d08fc-6866-4407-907a-bd899ff03176 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3" status: 200 len: 1735 microversion: 2.1 time: 0.162703 Aug 09 07:06:21.554118 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 279/562] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:06:21 2022] GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:06:22.577090 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-855dc5a0-1767-4a02-9558-1d6fc43877d1 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:22.577778 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-855dc5a0-1767-4a02-9558-1d6fc43877d1 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 51b65dde-1fef-4daa-9475-7609ac03dbc3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:22.583887 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-855dc5a0-1767-4a02-9558-1d6fc43877d1 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:22.584365 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-855dc5a0-1767-4a02-9558-1d6fc43877d1 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:22.584797 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-855dc5a0-1767-4a02-9558-1d6fc43877d1 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:22.585694 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-855dc5a0-1767-4a02-9558-1d6fc43877d1 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:22.586387 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-855dc5a0-1767-4a02-9558-1d6fc43877d1 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:22.586821 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-855dc5a0-1767-4a02-9558-1d6fc43877d1 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:22.717352 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-855dc5a0-1767-4a02-9558-1d6fc43877d1 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:22.725217 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-855dc5a0-1767-4a02-9558-1d6fc43877d1 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3" status: 200 len: 1735 microversion: 2.1 time: 0.152918 Aug 09 07:06:22.725784 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 284/563] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:06:22 2022] GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:06:23.746320 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-1e845116-747a-4447-8ab6-7c188207a939 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:23.746925 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-1e845116-747a-4447-8ab6-7c188207a939 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 51b65dde-1fef-4daa-9475-7609ac03dbc3] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:23.753053 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1e845116-747a-4447-8ab6-7c188207a939 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:23.753816 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1e845116-747a-4447-8ab6-7c188207a939 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:23.754263 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1e845116-747a-4447-8ab6-7c188207a939 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:23.754943 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1e845116-747a-4447-8ab6-7c188207a939 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:23.755372 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1e845116-747a-4447-8ab6-7c188207a939 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:23.755844 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1e845116-747a-4447-8ab6-7c188207a939 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:23.884697 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-1e845116-747a-4447-8ab6-7c188207a939 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:23.892598 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-1e845116-747a-4447-8ab6-7c188207a939 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3" status: 200 len: 1735 microversion: 2.1 time: 0.150214 Aug 09 07:06:23.893159 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 280/564] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:06:23 2022] GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:06:24.914562 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-5bd2c206-0d38-4571-ae0e-32d2f92f589e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:24.915162 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-5bd2c206-0d38-4571-ae0e-32d2f92f589e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 51b65dde-1fef-4daa-9475-7609ac03dbc3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:24.921656 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5bd2c206-0d38-4571-ae0e-32d2f92f589e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:24.922125 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5bd2c206-0d38-4571-ae0e-32d2f92f589e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:24.922550 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5bd2c206-0d38-4571-ae0e-32d2f92f589e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:24.923235 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5bd2c206-0d38-4571-ae0e-32d2f92f589e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:24.923710 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5bd2c206-0d38-4571-ae0e-32d2f92f589e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:24.924131 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5bd2c206-0d38-4571-ae0e-32d2f92f589e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:25.053208 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-5bd2c206-0d38-4571-ae0e-32d2f92f589e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:25.061644 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-5bd2c206-0d38-4571-ae0e-32d2f92f589e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3" status: 200 len: 1735 microversion: 2.1 time: 0.151219 Aug 09 07:06:25.062201 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 285/565] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:06:24 2022] GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:06:25.955883 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-611c0729-29ee-408c-8445-79683c1f5dfa tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:25.956409 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-611c0729-29ee-408c-8445-79683c1f5dfa tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:25.962694 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-611c0729-29ee-408c-8445-79683c1f5dfa tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:25.963816 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-611c0729-29ee-408c-8445-79683c1f5dfa tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:25.964263 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-611c0729-29ee-408c-8445-79683c1f5dfa tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:25.964953 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-611c0729-29ee-408c-8445-79683c1f5dfa tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:25.965409 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-611c0729-29ee-408c-8445-79683c1f5dfa tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:25.965831 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-611c0729-29ee-408c-8445-79683c1f5dfa tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:25.995832 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-611c0729-29ee-408c-8445-79683c1f5dfa tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e/os-volume_attachments/e8d10615-3582-4706-9c4a-e2eacd635fe4" status: 200 len: 194 microversion: 2.20 time: 0.043984 Aug 09 07:06:25.996402 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 281/566] 10.222.0.30 () {60 vars in 1454 bytes} [Tue Aug 9 07:06:25 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e/os-volume_attachments/e8d10615-3582-4706-9c4a-e2eacd635fe4 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 07:06:26.062438 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-1ec1435f-8f33-49f9-bd14-567c3a590eb3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:26.062966 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-1ec1435f-8f33-49f9-bd14-567c3a590eb3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:26.069309 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1ec1435f-8f33-49f9-bd14-567c3a590eb3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:26.069781 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1ec1435f-8f33-49f9-bd14-567c3a590eb3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:26.070213 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1ec1435f-8f33-49f9-bd14-567c3a590eb3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:26.070897 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1ec1435f-8f33-49f9-bd14-567c3a590eb3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:26.071349 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1ec1435f-8f33-49f9-bd14-567c3a590eb3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:26.071822 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1ec1435f-8f33-49f9-bd14-567c3a590eb3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:26.083322 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-80adb55f-5ddd-484f-93e3-612ff5ea58aa tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:26.083993 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-80adb55f-5ddd-484f-93e3-612ff5ea58aa tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 51b65dde-1fef-4daa-9475-7609ac03dbc3] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:26.090620 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-80adb55f-5ddd-484f-93e3-612ff5ea58aa tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:26.091103 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-80adb55f-5ddd-484f-93e3-612ff5ea58aa tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:26.091536 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-80adb55f-5ddd-484f-93e3-612ff5ea58aa tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:26.092260 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-80adb55f-5ddd-484f-93e3-612ff5ea58aa tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:26.092701 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-80adb55f-5ddd-484f-93e3-612ff5ea58aa tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:26.093122 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-80adb55f-5ddd-484f-93e3-612ff5ea58aa tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:26.157434 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.objects.instance [None req-1ec1435f-8f33-49f9-bd14-567c3a590eb3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lazy-loading 'services' on Instance uuid 2236b6b2-39b4-4b81-bb86-006774babc2e {{(pid=117859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 07:06:26.230001 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-80adb55f-5ddd-484f-93e3-612ff5ea58aa tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:26.240622 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-1ec1435f-8f33-49f9-bd14-567c3a590eb3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e/os-volume_attachments/e8d10615-3582-4706-9c4a-e2eacd635fe4" status: 202 len: 0 microversion: 2.20 time: 0.181901 Aug 09 07:06:26.242013 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 286/567] 10.222.0.30 () {60 vars in 1457 bytes} [Tue Aug 9 07:06:26 2022] DELETE /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e/os-volume_attachments/e8d10615-3582-4706-9c4a-e2eacd635fe4 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 09 07:06:26.243258 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-80adb55f-5ddd-484f-93e3-612ff5ea58aa tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3" status: 200 len: 1735 microversion: 2.1 time: 0.163710 Aug 09 07:06:26.255639 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 282/568] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:06:26 2022] GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:06:26.255862 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-5c42f92b-2fc5-4f72-9181-3bc2914501e2 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:26.255862 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-5c42f92b-2fc5-4f72-9181-3bc2914501e2 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:26.263338 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5c42f92b-2fc5-4f72-9181-3bc2914501e2 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:26.263893 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5c42f92b-2fc5-4f72-9181-3bc2914501e2 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:26.264399 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5c42f92b-2fc5-4f72-9181-3bc2914501e2 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:26.265140 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5c42f92b-2fc5-4f72-9181-3bc2914501e2 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:26.265604 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5c42f92b-2fc5-4f72-9181-3bc2914501e2 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:26.266026 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5c42f92b-2fc5-4f72-9181-3bc2914501e2 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:26.301161 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-5c42f92b-2fc5-4f72-9181-3bc2914501e2 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053652 Aug 09 07:06:26.301737 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 287/569] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 9 07:06:26 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 07:06:27.266172 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-feb21f23-9a95-4c15-b29f-3e1823edb2d2 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:27.266774 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-feb21f23-9a95-4c15-b29f-3e1823edb2d2 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 51b65dde-1fef-4daa-9475-7609ac03dbc3] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:27.273125 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-feb21f23-9a95-4c15-b29f-3e1823edb2d2 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:27.273599 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-feb21f23-9a95-4c15-b29f-3e1823edb2d2 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:27.274057 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-feb21f23-9a95-4c15-b29f-3e1823edb2d2 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:27.274737 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-feb21f23-9a95-4c15-b29f-3e1823edb2d2 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:27.275183 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-feb21f23-9a95-4c15-b29f-3e1823edb2d2 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:27.276201 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-feb21f23-9a95-4c15-b29f-3e1823edb2d2 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:27.313709 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6954f016-a7f0-4599-86ad-0a3a34093988 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:27.315850 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-6954f016-a7f0-4599-86ad-0a3a34093988 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:27.318282 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:06:27.324426 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6954f016-a7f0-4599-86ad-0a3a34093988 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:27.324902 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6954f016-a7f0-4599-86ad-0a3a34093988 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:27.325337 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6954f016-a7f0-4599-86ad-0a3a34093988 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:27.326040 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6954f016-a7f0-4599-86ad-0a3a34093988 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:27.326490 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6954f016-a7f0-4599-86ad-0a3a34093988 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:27.326911 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6954f016-a7f0-4599-86ad-0a3a34093988 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:27.358831 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-6954f016-a7f0-4599-86ad-0a3a34093988 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049071 Aug 09 07:06:27.365295 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 288/570] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 9 07:06:27 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:06:27.412346 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-feb21f23-9a95-4c15-b29f-3e1823edb2d2 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:27.420834 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-feb21f23-9a95-4c15-b29f-3e1823edb2d2 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3" status: 200 len: 1715 microversion: 2.1 time: 0.158558 Aug 09 07:06:27.421389 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 283/571] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:06:27 2022] GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3 => generated 1715 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:06:27.422888 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-fa29c73b-0aaf-45a4-9186-af949df7661c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:27.423378 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-fa29c73b-0aaf-45a4-9186-af949df7661c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:27.429399 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fa29c73b-0aaf-45a4-9186-af949df7661c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:27.429821 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fa29c73b-0aaf-45a4-9186-af949df7661c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:27.430255 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fa29c73b-0aaf-45a4-9186-af949df7661c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:27.431473 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fa29c73b-0aaf-45a4-9186-af949df7661c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:27.431473 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fa29c73b-0aaf-45a4-9186-af949df7661c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:27.431865 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fa29c73b-0aaf-45a4-9186-af949df7661c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:27.457652 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-fa29c73b-0aaf-45a4-9186-af949df7661c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Going to try to terminate instance {{(pid=117859) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 07:06:27.532869 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-9cf5f2a8-d5c4-4040-a0cb-8c57ae22d36d tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:27.533746 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-9cf5f2a8-d5c4-4040-a0cb-8c57ae22d36d tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 51b65dde-1fef-4daa-9475-7609ac03dbc3] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:27.540550 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9cf5f2a8-d5c4-4040-a0cb-8c57ae22d36d tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:27.541034 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9cf5f2a8-d5c4-4040-a0cb-8c57ae22d36d tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:27.541576 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9cf5f2a8-d5c4-4040-a0cb-8c57ae22d36d tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:27.542076 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-fa29c73b-0aaf-45a4-9186-af949df7661c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 204 len: 0 microversion: 2.20 time: 0.122713 Aug 09 07:06:27.542538 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9cf5f2a8-d5c4-4040-a0cb-8c57ae22d36d tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:27.542686 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 289/572] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Aug 9 07:06:27 2022] DELETE /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 09 07:06:27.542993 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9cf5f2a8-d5c4-4040-a0cb-8c57ae22d36d tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:27.543416 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9cf5f2a8-d5c4-4040-a0cb-8c57ae22d36d tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:27.550961 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-453fbf03-329d-4909-ae92-9d0a10c49835 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:27.551665 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-453fbf03-329d-4909-ae92-9d0a10c49835 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:27.557522 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-453fbf03-329d-4909-ae92-9d0a10c49835 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:27.557996 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-453fbf03-329d-4909-ae92-9d0a10c49835 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:27.558423 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-453fbf03-329d-4909-ae92-9d0a10c49835 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:27.559095 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-453fbf03-329d-4909-ae92-9d0a10c49835 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:27.559541 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-453fbf03-329d-4909-ae92-9d0a10c49835 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:27.559997 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-453fbf03-329d-4909-ae92-9d0a10c49835 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:27.668531 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.wsgi [None req-9cf5f2a8-d5c4-4040-a0cb-8c57ae22d36d tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] HTTP exception thrown: Cannot 'detach_volume' instance 51b65dde-1fef-4daa-9475-7609ac03dbc3 while it is in vm_state rescued Aug 09 07:06:27.670221 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-9cf5f2a8-d5c4-4040-a0cb-8c57ae22d36d tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Request method failure captured: Aug 09 07:06:27.670221 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: request: DELETE /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3/os-volume_attachments/3249df34-5152-4d22-9b99-9b04ffa27706 HTTP/1.1 Aug 09 07:06:27.670221 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Accept: application/json Aug 09 07:06:27.670221 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Accept-Encoding: identity Aug 09 07:06:27.670221 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Connection: close Aug 09 07:06:27.670221 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Content-Length: 0 Aug 09 07:06:27.670221 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Content-Type: application/json Aug 09 07:06:27.670221 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Host: 10.222.0.30 Aug 09 07:06:27.670221 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Openstack-System-Scope: None Aug 09 07:06:27.670221 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: User-Agent: python-urllib3/1.26.11 Aug 09 07:06:27.670221 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Auth-Token: gAAAAABi8gaR68LUg4fD8olNfnhK5rGsuZLf2x3TIzuy1CUG3sPjpuV_p2f6hy7YLAChvAXkrqy9P06phVXme741Qxk922cto6wMDgT9kUn7Yz0BZVivdWCpYNCbvZ_IUlx12VWDEDp0qoNPhO2SGvBasUprpkpWeSpi9qySzJJVs0D_hnkcro8 Aug 09 07:06:27.670221 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Domain-Id: None Aug 09 07:06:27.670221 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Domain-Name: None Aug 09 07:06:27.670221 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Identity-Status: Confirmed Aug 09 07:06:27.670221 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Is-Admin-Project: True Aug 09 07:06:27.670221 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Domain-Id: default Aug 09 07:06:27.670221 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Domain-Name: Default Aug 09 07:06:27.670221 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Id: 517f3dedc5da431b87e398003506c06b Aug 09 07:06:27.670221 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1447651910 Aug 09 07:06:27.670221 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Role: reader,member Aug 09 07:06:27.670221 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Roles: reader,member Aug 09 07:06:27.671653 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/517f3dedc5da431b87e398003506c06b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_517f3dedc5da431b87e398003506c06b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/517f3dedc5da431b87e398003506c06b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/517f3dedc5da431b87e398003506c06b"}]}] Aug 09 07:06:27.671653 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1447651910 Aug 09 07:06:27.671653 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant-Id: 517f3dedc5da431b87e398003506c06b Aug 09 07:06:27.671653 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1447651910 Aug 09 07:06:27.671653 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User: tempest-ServerRescueNegativeTestJSON-1447651910-project Aug 09 07:06:27.671653 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Domain-Id: default Aug 09 07:06:27.671653 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Domain-Name: Default Aug 09 07:06:27.671653 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Id: 19da3c426c6e4c4a889ab5017804c92e Aug 09 07:06:27.671653 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1447651910-project Aug 09 07:06:27.671653 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: method: > Aug 09 07:06:27.671653 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: exception: Cannot 'detach_volume' instance 51b65dde-1fef-4daa-9475-7609ac03dbc3 while it is in vm_state rescued Aug 09 07:06:27.672529 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: action_args: {'server_id': '51b65dde-1fef-4daa-9475-7609ac03dbc3', 'id': '3249df34-5152-4d22-9b99-9b04ffa27706'} Aug 09 07:06:27.672529 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 07:06:27.672529 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:06:27.672529 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 09 07:06:27.672529 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 09 07:06:27.672529 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 07:06:27.672529 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 07:06:27.672529 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 09 07:06:27.672529 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 09 07:06:27.672529 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 51b65dde-1fef-4daa-9475-7609ac03dbc3 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 09 07:06:27.672529 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:06:27.672529 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:06:27.672529 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:06:27.672529 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:06:27.672529 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:06:27.672529 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:06:27.672529 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 07:06:27.672529 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 07:06:27.672529 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 07:06:27.672529 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 07:06:27.674017 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 09 07:06:27.674017 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 09 07:06:27.674017 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 09 07:06:27.674017 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 09 07:06:27.674017 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 51b65dde-1fef-4daa-9475-7609ac03dbc3 while it is in vm_state rescued Aug 09 07:06:27.674017 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:06:27.674017 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:06:27.674017 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:06:27.674017 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:06:27.674017 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:06:27.674017 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:06:27.674017 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 07:06:27.674017 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 07:06:27.674017 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 51b65dde-1fef-4daa-9475-7609ac03dbc3 while it is in vm_state rescued Aug 09 07:06:27.674017 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:06:27.674017 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-9cf5f2a8-d5c4-4040-a0cb-8c57ae22d36d tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Returning 409 to user: Cannot 'detach_volume' instance 51b65dde-1fef-4daa-9475-7609ac03dbc3 while it is in vm_state rescued {{(pid=117858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 07:06:27.675141 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-9cf5f2a8-d5c4-4040-a0cb-8c57ae22d36d tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "DELETE /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3/os-volume_attachments/3249df34-5152-4d22-9b99-9b04ffa27706" status: 409 len: 152 microversion: 2.1 time: 0.143860 Aug 09 07:06:27.675141 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 284/573] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Aug 9 07:06:27 2022] DELETE /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3/os-volume_attachments/3249df34-5152-4d22-9b99-9b04ffa27706 => generated 152 bytes in 145 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 09 07:06:27.680356 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-9af05086-e0b4-4156-92b2-f2f07c4f4c7d tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:06:27.680834 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-9af05086-e0b4-4156-92b2-f2f07c4f4c7d tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 51b65dde-1fef-4daa-9475-7609ac03dbc3] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:27.687203 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9af05086-e0b4-4156-92b2-f2f07c4f4c7d tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:27.687717 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9af05086-e0b4-4156-92b2-f2f07c4f4c7d tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:27.688162 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9af05086-e0b4-4156-92b2-f2f07c4f4c7d tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:27.688880 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9af05086-e0b4-4156-92b2-f2f07c4f4c7d tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:27.689360 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9af05086-e0b4-4156-92b2-f2f07c4f4c7d tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:27.689762 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9af05086-e0b4-4156-92b2-f2f07c4f4c7d tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:27.702051 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-453fbf03-329d-4909-ae92-9d0a10c49835 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:27.709959 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-453fbf03-329d-4909-ae92-9d0a10c49835 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:27.711458 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-453fbf03-329d-4909-ae92-9d0a10c49835 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:27.712614 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-453fbf03-329d-4909-ae92-9d0a10c49835 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1721 microversion: 2.20 time: 0.165708 Aug 09 07:06:27.713223 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 290/574] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:06:27 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 07:06:27.756207 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-9af05086-e0b4-4156-92b2-f2f07c4f4c7d tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "POST /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3/action" status: 202 len: 0 microversion: 2.1 time: 0.079256 Aug 09 07:06:27.756984 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 285/575] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 9 07:06:27 2022] POST /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 07:06:27.766355 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c61383bc-b067-4c43-ba19-e99acb896537 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:27.766952 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c61383bc-b067-4c43-ba19-e99acb896537 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 51b65dde-1fef-4daa-9475-7609ac03dbc3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:27.773013 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c61383bc-b067-4c43-ba19-e99acb896537 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:27.773512 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c61383bc-b067-4c43-ba19-e99acb896537 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:27.773940 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c61383bc-b067-4c43-ba19-e99acb896537 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:27.774616 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c61383bc-b067-4c43-ba19-e99acb896537 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:27.775065 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c61383bc-b067-4c43-ba19-e99acb896537 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:27.775530 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c61383bc-b067-4c43-ba19-e99acb896537 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:27.904158 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c61383bc-b067-4c43-ba19-e99acb896537 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:27.912010 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c61383bc-b067-4c43-ba19-e99acb896537 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3" status: 200 len: 1723 microversion: 2.1 time: 0.149818 Aug 09 07:06:27.912574 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 291/576] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:06:27 2022] GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:06:28.737257 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-93e574d9-f0d7-4ff7-88a2-781814b19c13 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:28.737868 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-93e574d9-f0d7-4ff7-88a2-781814b19c13 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:28.743864 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-93e574d9-f0d7-4ff7-88a2-781814b19c13 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:28.744440 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-93e574d9-f0d7-4ff7-88a2-781814b19c13 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:28.745290 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-93e574d9-f0d7-4ff7-88a2-781814b19c13 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:28.745970 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-93e574d9-f0d7-4ff7-88a2-781814b19c13 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:28.746414 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-93e574d9-f0d7-4ff7-88a2-781814b19c13 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:28.746829 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-93e574d9-f0d7-4ff7-88a2-781814b19c13 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:28.883669 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-93e574d9-f0d7-4ff7-88a2-781814b19c13 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:28.892450 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-93e574d9-f0d7-4ff7-88a2-781814b19c13 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:28.893943 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-93e574d9-f0d7-4ff7-88a2-781814b19c13 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:28.895080 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-93e574d9-f0d7-4ff7-88a2-781814b19c13 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1721 microversion: 2.20 time: 0.162730 Aug 09 07:06:28.895640 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 286/577] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:06:28 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:06:28.934000 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a48e701b-bd97-43e5-afae-47a738adbdd5 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:28.934609 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-a48e701b-bd97-43e5-afae-47a738adbdd5 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 51b65dde-1fef-4daa-9475-7609ac03dbc3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:28.941117 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a48e701b-bd97-43e5-afae-47a738adbdd5 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:28.941593 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a48e701b-bd97-43e5-afae-47a738adbdd5 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:28.942049 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a48e701b-bd97-43e5-afae-47a738adbdd5 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:28.942715 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a48e701b-bd97-43e5-afae-47a738adbdd5 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:28.943179 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a48e701b-bd97-43e5-afae-47a738adbdd5 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:28.943624 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a48e701b-bd97-43e5-afae-47a738adbdd5 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:29.075943 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-a48e701b-bd97-43e5-afae-47a738adbdd5 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:29.083902 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-a48e701b-bd97-43e5-afae-47a738adbdd5 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3" status: 200 len: 1723 microversion: 2.1 time: 0.154302 Aug 09 07:06:29.084463 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 292/578] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:06:28 2022] GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:06:29.920197 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-9a5e3573-d149-4544-b492-80b1e8d750e0 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:29.920806 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-9a5e3573-d149-4544-b492-80b1e8d750e0 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:29.927220 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9a5e3573-d149-4544-b492-80b1e8d750e0 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:29.927742 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9a5e3573-d149-4544-b492-80b1e8d750e0 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:29.928184 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9a5e3573-d149-4544-b492-80b1e8d750e0 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:29.928880 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9a5e3573-d149-4544-b492-80b1e8d750e0 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:29.929332 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9a5e3573-d149-4544-b492-80b1e8d750e0 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:29.929888 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9a5e3573-d149-4544-b492-80b1e8d750e0 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:30.061039 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-9a5e3573-d149-4544-b492-80b1e8d750e0 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:30.069218 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-9a5e3573-d149-4544-b492-80b1e8d750e0 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:30.070884 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-9a5e3573-d149-4544-b492-80b1e8d750e0 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:30.072066 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-9a5e3573-d149-4544-b492-80b1e8d750e0 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1721 microversion: 2.20 time: 0.156568 Aug 09 07:06:30.072897 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 287/579] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:06:29 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:06:30.106649 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-216c01c5-6ce0-4606-bbd4-88de149bc10e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:30.108247 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-216c01c5-6ce0-4606-bbd4-88de149bc10e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 51b65dde-1fef-4daa-9475-7609ac03dbc3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:30.115752 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-216c01c5-6ce0-4606-bbd4-88de149bc10e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:30.116419 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-216c01c5-6ce0-4606-bbd4-88de149bc10e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:30.116861 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-216c01c5-6ce0-4606-bbd4-88de149bc10e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:30.117585 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-216c01c5-6ce0-4606-bbd4-88de149bc10e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:30.118062 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-216c01c5-6ce0-4606-bbd4-88de149bc10e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:30.118492 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-216c01c5-6ce0-4606-bbd4-88de149bc10e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:30.121513 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:06:30.269986 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-216c01c5-6ce0-4606-bbd4-88de149bc10e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:30.278543 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-216c01c5-6ce0-4606-bbd4-88de149bc10e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3" status: 200 len: 1723 microversion: 2.1 time: 0.176618 Aug 09 07:06:30.279122 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 293/580] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:06:30 2022] GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3 => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:06:30.495650 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [req-0b756492-88cb-43b8-a177-ba3cfb2af0a0 req-90aec685-4e97-4354-abdf-4a20669efbbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2236b6b2-39b4-4b81-bb86-006774babc2e", "name": "network-vif-deleted", "tag": "ada64d06-0764-4487-9425-780bad419035"}]} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:06:30.505278 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-0b756492-88cb-43b8-a177-ba3cfb2af0a0 req-90aec685-4e97-4354-abdf-4a20669efbbe service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:30.505702 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-0b756492-88cb-43b8-a177-ba3cfb2af0a0 req-90aec685-4e97-4354-abdf-4a20669efbbe service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:30.506129 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-0b756492-88cb-43b8-a177-ba3cfb2af0a0 req-90aec685-4e97-4354-abdf-4a20669efbbe service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:30.520107 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.compute.server_external_events [req-0b756492-88cb-43b8-a177-ba3cfb2af0a0 req-90aec685-4e97-4354-abdf-4a20669efbbe service nova] Creating event network-vif-deleted:ada64d06-0764-4487-9425-780bad419035 for instance 2236b6b2-39b4-4b81-bb86-006774babc2e on hv-cinder-85251 Aug 09 07:06:30.524879 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [req-0b756492-88cb-43b8-a177-ba3cfb2af0a0 req-90aec685-4e97-4354-abdf-4a20669efbbe service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032983 Aug 09 07:06:30.525510 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 288/581] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:06:31.095259 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-be95c43f-4cbe-49df-8c82-c16edbadb750 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:31.095905 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-be95c43f-4cbe-49df-8c82-c16edbadb750 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:31.101912 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-be95c43f-4cbe-49df-8c82-c16edbadb750 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:31.102391 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-be95c43f-4cbe-49df-8c82-c16edbadb750 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:31.102826 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-be95c43f-4cbe-49df-8c82-c16edbadb750 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:31.103553 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-be95c43f-4cbe-49df-8c82-c16edbadb750 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:31.104039 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-be95c43f-4cbe-49df-8c82-c16edbadb750 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:31.104463 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-be95c43f-4cbe-49df-8c82-c16edbadb750 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:31.168406 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-be95c43f-4cbe-49df-8c82-c16edbadb750 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:31.176658 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-be95c43f-4cbe-49df-8c82-c16edbadb750 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:31.178337 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-be95c43f-4cbe-49df-8c82-c16edbadb750 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:31.180094 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-be95c43f-4cbe-49df-8c82-c16edbadb750 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 200 len: 1654 microversion: 2.20 time: 0.088466 Aug 09 07:06:31.180661 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 294/582] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:06:31 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 1654 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:06:31.301547 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-5a49ca34-0a1b-43c6-beda-2fb6f7941e16 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:31.302302 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-5a49ca34-0a1b-43c6-beda-2fb6f7941e16 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 51b65dde-1fef-4daa-9475-7609ac03dbc3] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:31.308655 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5a49ca34-0a1b-43c6-beda-2fb6f7941e16 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:31.309139 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5a49ca34-0a1b-43c6-beda-2fb6f7941e16 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:31.309567 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5a49ca34-0a1b-43c6-beda-2fb6f7941e16 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:31.310286 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5a49ca34-0a1b-43c6-beda-2fb6f7941e16 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:31.310733 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5a49ca34-0a1b-43c6-beda-2fb6f7941e16 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:31.311821 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5a49ca34-0a1b-43c6-beda-2fb6f7941e16 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:31.445853 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-5a49ca34-0a1b-43c6-beda-2fb6f7941e16 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:31.454524 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-5a49ca34-0a1b-43c6-beda-2fb6f7941e16 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3" status: 200 len: 1723 microversion: 2.1 time: 0.157709 Aug 09 07:06:31.455091 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 289/583] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:06:31 2022] GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:06:32.202427 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2552ec05-0dfe-4386-9e91-0e1e06f0921c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:32.203034 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-2552ec05-0dfe-4386-9e91-0e1e06f0921c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:32.209339 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2552ec05-0dfe-4386-9e91-0e1e06f0921c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:32.209818 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2552ec05-0dfe-4386-9e91-0e1e06f0921c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:32.210257 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2552ec05-0dfe-4386-9e91-0e1e06f0921c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:32.210938 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2552ec05-0dfe-4386-9e91-0e1e06f0921c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:32.211472 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2552ec05-0dfe-4386-9e91-0e1e06f0921c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:32.211925 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2552ec05-0dfe-4386-9e91-0e1e06f0921c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:32.229366 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-2552ec05-0dfe-4386-9e91-0e1e06f0921c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] HTTP exception thrown: Instance 2236b6b2-39b4-4b81-bb86-006774babc2e could not be found. Aug 09 07:06:32.231014 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2552ec05-0dfe-4386-9e91-0e1e06f0921c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Request method failure captured: Aug 09 07:06:32.231014 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e HTTP/1.1 Aug 09 07:06:32.231014 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 09 07:06:32.231014 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 09 07:06:32.231014 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Connection: close Aug 09 07:06:32.231014 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Length: 0 Aug 09 07:06:32.231014 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 09 07:06:32.231014 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.30 Aug 09 07:06:32.231014 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 09 07:06:32.231014 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.11 Aug 09 07:06:32.231014 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi8gaRnSbbfLxfTalYzBSaazV26j8bqFLOBP1hFBUp7vKdmILNtFaGrVx8tLaUtHWXCdnAqpWrDgpK4RVv38wYFHwiqywSOI5IHzDHuiAQSIwLgKz7VDBMeuVzxM3n4zrHUJggy_VUwD22etwQ6V3CGPMPurPyE0ajsYjBVLVrwiTEU0M Aug 09 07:06:32.231014 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 09 07:06:32.231014 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 09 07:06:32.231014 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 09 07:06:32.231014 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 09 07:06:32.231014 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 07:06:32.231014 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 09 07:06:32.231014 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 09 07:06:32.231014 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Id: 10c7e20a9669439fa43853dab6f9851c Aug 09 07:06:32.231014 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2041815482 Aug 09 07:06:32.231014 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 09 07:06:32.231014 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 09 07:06:32.232654 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/10c7e20a9669439fa43853dab6f9851c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_10c7e20a9669439fa43853dab6f9851c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/10c7e20a9669439fa43853dab6f9851c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/10c7e20a9669439fa43853dab6f9851c"}]}] Aug 09 07:06:32.232654 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2041815482 Aug 09 07:06:32.232654 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: 10c7e20a9669439fa43853dab6f9851c Aug 09 07:06:32.232654 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2041815482 Aug 09 07:06:32.232654 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User: tempest-AttachVolumeShelveTestJSON-2041815482-project Aug 09 07:06:32.232654 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 09 07:06:32.232654 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 09 07:06:32.232654 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Id: 0bb72c5f52fc498aa60eecba3bd5248a Aug 09 07:06:32.232654 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2041815482-project Aug 09 07:06:32.232654 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: method: > Aug 09 07:06:32.232654 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: exception: Instance 2236b6b2-39b4-4b81-bb86-006774babc2e could not be found. Aug 09 07:06:32.232654 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: action_args: {'id': '2236b6b2-39b4-4b81-bb86-006774babc2e'} Aug 09 07:06:32.233584 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 07:06:32.233584 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:06:32.233584 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 07:06:32.233584 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 07:06:32.233584 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 07:06:32.233584 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 07:06:32.233584 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 07:06:32.233584 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 07:06:32.233584 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 07:06:32.233584 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 07:06:32.233584 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2236b6b2-39b4-4b81-bb86-006774babc2e could not be found. Aug 09 07:06:32.233584 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:06:32.233584 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:06:32.233584 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:06:32.233584 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:06:32.233584 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:06:32.233584 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:06:32.233584 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 07:06:32.233584 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 07:06:32.233584 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 07:06:32.235189 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 07:06:32.235189 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 07:06:32.235189 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 07:06:32.235189 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 07:06:32.235189 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 07:06:32.235189 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 07:06:32.235189 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 07:06:32.235189 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2236b6b2-39b4-4b81-bb86-006774babc2e could not be found. Aug 09 07:06:32.235189 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:06:32.235189 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:06:32.235189 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:06:32.235189 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:06:32.235189 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:06:32.235189 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:06:32.235189 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 07:06:32.235189 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 07:06:32.235189 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2236b6b2-39b4-4b81-bb86-006774babc2e could not be found. Aug 09 07:06:32.235189 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:06:32.236591 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2552ec05-0dfe-4386-9e91-0e1e06f0921c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Returning 404 to user: Instance 2236b6b2-39b4-4b81-bb86-006774babc2e could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 07:06:32.236591 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-2552ec05-0dfe-4386-9e91-0e1e06f0921c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 404 len: 111 microversion: 2.20 time: 0.034086 Aug 09 07:06:32.236591 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 295/584] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:06:32 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 07:06:32.241906 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-eef5f510-16a7-48b7-b073-603e99a5921a tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '.version_select at 0x7f20ddc2ec10>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:32.260798 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-eef5f510-16a7-48b7-b073-603e99a5921a tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-917474738" status: 204 len: 0 microversion: 2.20 time: 0.022529 Aug 09 07:06:32.261346 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 290/585] 10.222.0.30 () {60 vars in 1259 bytes} [Tue Aug 9 07:06:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-917474738 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 07:06:32.476012 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-ab25d0f5-cd83-42af-b8d3-58a95fd1ca09 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:32.476618 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-ab25d0f5-cd83-42af-b8d3-58a95fd1ca09 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 51b65dde-1fef-4daa-9475-7609ac03dbc3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:32.483899 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ab25d0f5-cd83-42af-b8d3-58a95fd1ca09 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:32.484379 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ab25d0f5-cd83-42af-b8d3-58a95fd1ca09 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:32.484804 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ab25d0f5-cd83-42af-b8d3-58a95fd1ca09 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:32.485493 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ab25d0f5-cd83-42af-b8d3-58a95fd1ca09 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:32.485940 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ab25d0f5-cd83-42af-b8d3-58a95fd1ca09 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:32.486359 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ab25d0f5-cd83-42af-b8d3-58a95fd1ca09 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:32.621175 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ab25d0f5-cd83-42af-b8d3-58a95fd1ca09 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:32.629859 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-ab25d0f5-cd83-42af-b8d3-58a95fd1ca09 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3" status: 200 len: 1729 microversion: 2.1 time: 0.157711 Aug 09 07:06:32.630429 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 296/586] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:06:32 2022] GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:06:32.651670 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-cd4a75f8-c4bc-4769-987f-f6b6eb13002e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:32.652223 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-cd4a75f8-c4bc-4769-987f-f6b6eb13002e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 51b65dde-1fef-4daa-9475-7609ac03dbc3] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:32.658701 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cd4a75f8-c4bc-4769-987f-f6b6eb13002e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:32.659189 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cd4a75f8-c4bc-4769-987f-f6b6eb13002e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:32.659654 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cd4a75f8-c4bc-4769-987f-f6b6eb13002e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:32.660362 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cd4a75f8-c4bc-4769-987f-f6b6eb13002e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:32.660820 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cd4a75f8-c4bc-4769-987f-f6b6eb13002e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:32.661250 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cd4a75f8-c4bc-4769-987f-f6b6eb13002e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:32.740181 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-cd4a75f8-c4bc-4769-987f-f6b6eb13002e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093035 Aug 09 07:06:32.740795 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 291/587] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Aug 9 07:06:32 2022] GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:06:32.902655 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a4afe255-3d66-4e1f-a1ee-a40065d540cd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Action: 'create', calling method: .version_select at 0x7f20dd3dc0d0>, body: {"keypair": {"name": "tempest-keypair-1488813531", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2t/kVHOvBiNhbC0GMLOv6qJELxJYSiR51ScBMuzUxN953ljQht4RkpEgp3et0lWCZC/gmHUAz7cBbs7M0vdKYNJehdPLPAaqfTAIQkhy+lECfoUo+awpT5NhMfhxNXvw=="}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:06:32.918282 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-a4afe255-3d66-4e1f-a1ee-a40065d540cd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Getting quotas for project 10c7e20a9669439fa43853dab6f9851c. Resources: {'key_pairs'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 07:06:32.922112 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-a4afe255-3d66-4e1f-a1ee-a40065d540cd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Getting quotas for user 0bb72c5f52fc498aa60eecba3bd5248a and project 10c7e20a9669439fa43853dab6f9851c. Resources: {'key_pairs'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 07:06:32.944356 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-a4afe255-3d66-4e1f-a1ee-a40065d540cd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.046075 Aug 09 07:06:32.944878 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 297/588] 10.222.0.30 () {62 vars in 1200 bytes} [Tue Aug 9 07:06:32 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 47 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 09 07:06:33.633868 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [req-738b6f2d-4250-4f0e-9fd9-96652885c4a1 req-8b21495e-a40b-402a-ae67-53b71498a6a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51b65dde-1fef-4daa-9475-7609ac03dbc3", "tag": "3d698374-c39d-4ddd-8c8b-02b917b63085"}]} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:06:33.646361 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-738b6f2d-4250-4f0e-9fd9-96652885c4a1 req-8b21495e-a40b-402a-ae67-53b71498a6a0 service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:33.647105 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-738b6f2d-4250-4f0e-9fd9-96652885c4a1 req-8b21495e-a40b-402a-ae67-53b71498a6a0 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:33.647828 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-738b6f2d-4250-4f0e-9fd9-96652885c4a1 req-8b21495e-a40b-402a-ae67-53b71498a6a0 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:33.660234 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.compute.server_external_events [req-738b6f2d-4250-4f0e-9fd9-96652885c4a1 req-8b21495e-a40b-402a-ae67-53b71498a6a0 service nova] Creating event network-changed:3d698374-c39d-4ddd-8c8b-02b917b63085 for instance 51b65dde-1fef-4daa-9475-7609ac03dbc3 on hv-cinder-85251 Aug 09 07:06:33.666802 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [req-738b6f2d-4250-4f0e-9fd9-96652885c4a1 req-8b21495e-a40b-402a-ae67-53b71498a6a0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036455 Aug 09 07:06:33.667779 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 292/589] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:06:34.643462 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-1ae1fe7e-adb7-4bc2-9f90-e25e2dd9c862 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-573139705", "imageRef": "5d2c35cc-2f3b-4a22-bd68-79c71882b6a2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0cace90e-712f-4834-be77-703a07a187a7"}], "security_groups": [{"name": "tempest-securitygroup--1345377234"}], "key_name": "tempest-keypair-1488813531", "user_data": "}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:06:34.743676 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.network.neutron [None req-1ae1fe7e-adb7-4bc2-9f90-e25e2dd9c862 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] validate_networks() for [('0cace90e-712f-4834-be77-703a07a187a7', None, None, None, None, None)] {{(pid=117859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 07:06:35.109190 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-1ae1fe7e-adb7-4bc2-9f90-e25e2dd9c862 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Flavor limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 07:06:35.109609 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-1ae1fe7e-adb7-4bc2-9f90-e25e2dd9c862 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Image limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 07:06:35.110079 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-1ae1fe7e-adb7-4bc2-9f90-e25e2dd9c862 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Flavor pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 07:06:35.110483 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-1ae1fe7e-adb7-4bc2-9f90-e25e2dd9c862 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Image pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 07:06:35.110884 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-1ae1fe7e-adb7-4bc2-9f90-e25e2dd9c862 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 07:06:35.119376 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1ae1fe7e-adb7-4bc2-9f90-e25e2dd9c862 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:35.119872 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1ae1fe7e-adb7-4bc2-9f90-e25e2dd9c862 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:35.120303 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1ae1fe7e-adb7-4bc2-9f90-e25e2dd9c862 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:35.121015 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1ae1fe7e-adb7-4bc2-9f90-e25e2dd9c862 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:35.121460 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1ae1fe7e-adb7-4bc2-9f90-e25e2dd9c862 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:35.121874 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1ae1fe7e-adb7-4bc2-9f90-e25e2dd9c862 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:35.139061 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-1ae1fe7e-adb7-4bc2-9f90-e25e2dd9c862 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Getting quotas for project 10c7e20a9669439fa43853dab6f9851c. Resources: {'cores', 'instances', 'ram'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 07:06:35.142978 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-1ae1fe7e-adb7-4bc2-9f90-e25e2dd9c862 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Getting quotas for user 0bb72c5f52fc498aa60eecba3bd5248a and project 10c7e20a9669439fa43853dab6f9851c. Resources: {'cores', 'instances', 'ram'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 07:06:35.154480 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-1ae1fe7e-adb7-4bc2-9f90-e25e2dd9c862 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Going to run 1 instances... {{(pid=117859) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 07:06:35.156747 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-1ae1fe7e-adb7-4bc2-9f90-e25e2dd9c862 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5d2c35cc-2f3b-4a22-bd68-79c71882b6a2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 07:06:35.202503 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-1ae1fe7e-adb7-4bc2-9f90-e25e2dd9c862 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.563586 Aug 09 07:06:35.203331 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 298/590] 10.222.0.30 () {62 vars in 1188 bytes} [Tue Aug 9 07:06:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 09 07:06:35.215845 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-2bdf344e-7e71-48c2-8d53-6bcfa080ec71 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:35.216590 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-2bdf344e-7e71-48c2-8d53-6bcfa080ec71 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:35.270456 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-2bdf344e-7e71-48c2-8d53-6bcfa080ec71 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:35.278151 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-2bdf344e-7e71-48c2-8d53-6bcfa080ec71 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:35.279784 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-2bdf344e-7e71-48c2-8d53-6bcfa080ec71 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:35.281038 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-2bdf344e-7e71-48c2-8d53-6bcfa080ec71 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 200 len: 1281 microversion: 2.20 time: 0.070792 Aug 09 07:06:35.281672 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 293/591] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:06:35 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 1281 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:06:35.680346 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-d7bbee87-3c5b-4d69-8145-e36f27a696f8 req-25bb0890-efe0-4a38-967f-ff5476c6b3a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51b65dde-1fef-4daa-9475-7609ac03dbc3", "tag": "3d698374-c39d-4ddd-8c8b-02b917b63085"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:06:35.691054 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-d7bbee87-3c5b-4d69-8145-e36f27a696f8 req-25bb0890-efe0-4a38-967f-ff5476c6b3a2 service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:35.691532 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-d7bbee87-3c5b-4d69-8145-e36f27a696f8 req-25bb0890-efe0-4a38-967f-ff5476c6b3a2 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:35.692022 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-d7bbee87-3c5b-4d69-8145-e36f27a696f8 req-25bb0890-efe0-4a38-967f-ff5476c6b3a2 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:35.703064 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-d7bbee87-3c5b-4d69-8145-e36f27a696f8 req-25bb0890-efe0-4a38-967f-ff5476c6b3a2 service nova] Creating event network-changed:3d698374-c39d-4ddd-8c8b-02b917b63085 for instance 51b65dde-1fef-4daa-9475-7609ac03dbc3 on hv-cinder-85251 Aug 09 07:06:35.708130 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-d7bbee87-3c5b-4d69-8145-e36f27a696f8 req-25bb0890-efe0-4a38-967f-ff5476c6b3a2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031419 Aug 09 07:06:35.708722 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 299/592] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 07:06:36.302357 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-77b574cc-ec59-4b96-bb3c-81d1acbfdf44 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:36.303128 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-77b574cc-ec59-4b96-bb3c-81d1acbfdf44 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:36.311644 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-77b574cc-ec59-4b96-bb3c-81d1acbfdf44 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:36.312390 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-77b574cc-ec59-4b96-bb3c-81d1acbfdf44 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:36.312861 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-77b574cc-ec59-4b96-bb3c-81d1acbfdf44 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:36.314022 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-77b574cc-ec59-4b96-bb3c-81d1acbfdf44 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:36.314477 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-77b574cc-ec59-4b96-bb3c-81d1acbfdf44 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:36.314991 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-77b574cc-ec59-4b96-bb3c-81d1acbfdf44 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:36.320313 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:06:36.390235 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-77b574cc-ec59-4b96-bb3c-81d1acbfdf44 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:36.398316 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-77b574cc-ec59-4b96-bb3c-81d1acbfdf44 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:36.399858 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-77b574cc-ec59-4b96-bb3c-81d1acbfdf44 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:36.401812 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-77b574cc-ec59-4b96-bb3c-81d1acbfdf44 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 200 len: 1339 microversion: 2.20 time: 0.103323 Aug 09 07:06:36.402668 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 294/593] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:06:36 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 1339 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 07:06:37.425410 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e79e9926-dbff-40f4-ab0b-81933db558de tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:37.426106 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-e79e9926-dbff-40f4-ab0b-81933db558de tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:37.432220 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e79e9926-dbff-40f4-ab0b-81933db558de tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:37.432702 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e79e9926-dbff-40f4-ab0b-81933db558de tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:37.433147 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e79e9926-dbff-40f4-ab0b-81933db558de tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:37.433839 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e79e9926-dbff-40f4-ab0b-81933db558de tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:37.434296 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e79e9926-dbff-40f4-ab0b-81933db558de tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:37.434726 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e79e9926-dbff-40f4-ab0b-81933db558de tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:37.598620 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e79e9926-dbff-40f4-ab0b-81933db558de tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:37.608162 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e79e9926-dbff-40f4-ab0b-81933db558de tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:37.613546 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e79e9926-dbff-40f4-ab0b-81933db558de tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:37.615451 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-e79e9926-dbff-40f4-ab0b-81933db558de tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 200 len: 1407 microversion: 2.20 time: 0.194823 Aug 09 07:06:37.618464 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 300/594] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:06:37 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:06:38.053179 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [req-44529f63-0893-458b-b84c-09a26703349e req-7a8689ce-e937-4e5c-b720-a92b68850eb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf38e7a7-b39a-4966-aa2d-effc83a555b8", "tag": "067648c9-4dd9-4848-a425-3cbbac00eedd"}]} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:06:38.069619 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-44529f63-0893-458b-b84c-09a26703349e req-7a8689ce-e937-4e5c-b720-a92b68850eb2 service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:38.070768 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-44529f63-0893-458b-b84c-09a26703349e req-7a8689ce-e937-4e5c-b720-a92b68850eb2 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:38.071869 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-44529f63-0893-458b-b84c-09a26703349e req-7a8689ce-e937-4e5c-b720-a92b68850eb2 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:38.089947 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.compute.server_external_events [req-44529f63-0893-458b-b84c-09a26703349e req-7a8689ce-e937-4e5c-b720-a92b68850eb2 service nova] Creating event network-changed:067648c9-4dd9-4848-a425-3cbbac00eedd for instance cf38e7a7-b39a-4966-aa2d-effc83a555b8 on hv-cinder-85251 Aug 09 07:06:38.096487 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [req-44529f63-0893-458b-b84c-09a26703349e req-7a8689ce-e937-4e5c-b720-a92b68850eb2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048612 Aug 09 07:06:38.097341 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 295/595] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:06:38.640983 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2a1b0003-fada-45b8-94d4-3fc73bc91f36 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:38.641620 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-2a1b0003-fada-45b8-94d4-3fc73bc91f36 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:38.648013 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2a1b0003-fada-45b8-94d4-3fc73bc91f36 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:38.648499 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2a1b0003-fada-45b8-94d4-3fc73bc91f36 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:38.648931 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2a1b0003-fada-45b8-94d4-3fc73bc91f36 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:38.649621 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2a1b0003-fada-45b8-94d4-3fc73bc91f36 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:38.650669 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2a1b0003-fada-45b8-94d4-3fc73bc91f36 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:38.651177 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2a1b0003-fada-45b8-94d4-3fc73bc91f36 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:38.781850 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2a1b0003-fada-45b8-94d4-3fc73bc91f36 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:38.789872 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2a1b0003-fada-45b8-94d4-3fc73bc91f36 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:38.791392 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2a1b0003-fada-45b8-94d4-3fc73bc91f36 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:38.792514 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-2a1b0003-fada-45b8-94d4-3fc73bc91f36 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 200 len: 1407 microversion: 2.20 time: 0.155455 Aug 09 07:06:38.793063 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 301/596] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:06:38 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:06:39.815389 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-c1f2b675-03c3-48b8-b7b9-62f6cc6c569c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:39.816099 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-c1f2b675-03c3-48b8-b7b9-62f6cc6c569c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:39.822839 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c1f2b675-03c3-48b8-b7b9-62f6cc6c569c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:39.823531 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c1f2b675-03c3-48b8-b7b9-62f6cc6c569c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:39.823990 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c1f2b675-03c3-48b8-b7b9-62f6cc6c569c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:39.824673 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c1f2b675-03c3-48b8-b7b9-62f6cc6c569c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:39.825119 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c1f2b675-03c3-48b8-b7b9-62f6cc6c569c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:39.825533 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c1f2b675-03c3-48b8-b7b9-62f6cc6c569c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:39.957728 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-c1f2b675-03c3-48b8-b7b9-62f6cc6c569c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:39.965638 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-c1f2b675-03c3-48b8-b7b9-62f6cc6c569c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:39.967141 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-c1f2b675-03c3-48b8-b7b9-62f6cc6c569c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:39.968270 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-c1f2b675-03c3-48b8-b7b9-62f6cc6c569c tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 200 len: 1407 microversion: 2.20 time: 0.157519 Aug 09 07:06:39.968820 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 296/597] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:06:39 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:06:40.990513 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-10c7e881-4481-48e0-9fea-1d0c07c4b663 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:40.991057 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-10c7e881-4481-48e0-9fea-1d0c07c4b663 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:40.997933 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-10c7e881-4481-48e0-9fea-1d0c07c4b663 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:40.998409 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-10c7e881-4481-48e0-9fea-1d0c07c4b663 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:40.998838 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-10c7e881-4481-48e0-9fea-1d0c07c4b663 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:40.999513 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-10c7e881-4481-48e0-9fea-1d0c07c4b663 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:40.999998 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-10c7e881-4481-48e0-9fea-1d0c07c4b663 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:41.000414 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-10c7e881-4481-48e0-9fea-1d0c07c4b663 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:41.133050 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-10c7e881-4481-48e0-9fea-1d0c07c4b663 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:41.141441 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-10c7e881-4481-48e0-9fea-1d0c07c4b663 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:41.142935 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-10c7e881-4481-48e0-9fea-1d0c07c4b663 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:41.144081 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-10c7e881-4481-48e0-9fea-1d0c07c4b663 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 200 len: 1407 microversion: 2.20 time: 0.157614 Aug 09 07:06:41.144636 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 302/598] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:06:40 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:06:42.167863 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-04531017-2989-49aa-b02f-0d7ccab3b42b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:42.168478 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-04531017-2989-49aa-b02f-0d7ccab3b42b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:42.174962 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-04531017-2989-49aa-b02f-0d7ccab3b42b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:42.175438 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-04531017-2989-49aa-b02f-0d7ccab3b42b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:42.175906 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-04531017-2989-49aa-b02f-0d7ccab3b42b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:42.176593 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-04531017-2989-49aa-b02f-0d7ccab3b42b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:42.177045 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-04531017-2989-49aa-b02f-0d7ccab3b42b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:42.177468 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-04531017-2989-49aa-b02f-0d7ccab3b42b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:42.310106 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-04531017-2989-49aa-b02f-0d7ccab3b42b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:42.317942 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-04531017-2989-49aa-b02f-0d7ccab3b42b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:42.319417 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-04531017-2989-49aa-b02f-0d7ccab3b42b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:42.320529 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-04531017-2989-49aa-b02f-0d7ccab3b42b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 200 len: 1407 microversion: 2.20 time: 0.157428 Aug 09 07:06:42.321082 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 297/599] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:06:42 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:06:42.858671 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-9644d8a6-caa7-4f2c-9543-055cd39d684e req-0d340f8d-0a60-4444-9345-4f7cd62554e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf38e7a7-b39a-4966-aa2d-effc83a555b8", "name": "network-vif-plugged", "status": "completed", "tag": "067648c9-4dd9-4848-a425-3cbbac00eedd"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:06:42.868497 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-9644d8a6-caa7-4f2c-9543-055cd39d684e req-0d340f8d-0a60-4444-9345-4f7cd62554e0 service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:42.869621 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-9644d8a6-caa7-4f2c-9543-055cd39d684e req-0d340f8d-0a60-4444-9345-4f7cd62554e0 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:42.870278 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-9644d8a6-caa7-4f2c-9543-055cd39d684e req-0d340f8d-0a60-4444-9345-4f7cd62554e0 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:42.882232 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-9644d8a6-caa7-4f2c-9543-055cd39d684e req-0d340f8d-0a60-4444-9345-4f7cd62554e0 service nova] Creating event network-vif-plugged:067648c9-4dd9-4848-a425-3cbbac00eedd for instance cf38e7a7-b39a-4966-aa2d-effc83a555b8 on hv-cinder-85251 Aug 09 07:06:42.888189 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-9644d8a6-caa7-4f2c-9543-055cd39d684e req-0d340f8d-0a60-4444-9345-4f7cd62554e0 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033104 Aug 09 07:06:42.889103 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 303/600] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:06:43.343932 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-05b3183b-245c-44a6-8678-2b7e3c630bbd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:43.344537 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-05b3183b-245c-44a6-8678-2b7e3c630bbd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:43.351576 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-05b3183b-245c-44a6-8678-2b7e3c630bbd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:43.352085 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-05b3183b-245c-44a6-8678-2b7e3c630bbd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:43.352519 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-05b3183b-245c-44a6-8678-2b7e3c630bbd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:43.353884 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-05b3183b-245c-44a6-8678-2b7e3c630bbd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:43.354510 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-05b3183b-245c-44a6-8678-2b7e3c630bbd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:43.354984 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-05b3183b-245c-44a6-8678-2b7e3c630bbd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:43.486271 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-05b3183b-245c-44a6-8678-2b7e3c630bbd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:43.494756 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-05b3183b-245c-44a6-8678-2b7e3c630bbd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:43.496288 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-05b3183b-245c-44a6-8678-2b7e3c630bbd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:43.497380 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-05b3183b-245c-44a6-8678-2b7e3c630bbd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 200 len: 1407 microversion: 2.20 time: 0.157465 Aug 09 07:06:43.497943 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 298/601] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:06:43 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:06:44.521104 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2aea0baa-b9aa-4b07-b6dc-2d4d14aecdbd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:44.521701 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-2aea0baa-b9aa-4b07-b6dc-2d4d14aecdbd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:44.528831 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2aea0baa-b9aa-4b07-b6dc-2d4d14aecdbd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:44.529299 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2aea0baa-b9aa-4b07-b6dc-2d4d14aecdbd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:44.529726 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2aea0baa-b9aa-4b07-b6dc-2d4d14aecdbd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:44.530410 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2aea0baa-b9aa-4b07-b6dc-2d4d14aecdbd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:44.530853 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2aea0baa-b9aa-4b07-b6dc-2d4d14aecdbd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:44.531269 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2aea0baa-b9aa-4b07-b6dc-2d4d14aecdbd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:44.664101 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2aea0baa-b9aa-4b07-b6dc-2d4d14aecdbd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:44.672941 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2aea0baa-b9aa-4b07-b6dc-2d4d14aecdbd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:44.674424 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2aea0baa-b9aa-4b07-b6dc-2d4d14aecdbd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:44.675519 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-2aea0baa-b9aa-4b07-b6dc-2d4d14aecdbd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 200 len: 1407 microversion: 2.20 time: 0.158745 Aug 09 07:06:44.676095 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 304/602] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:06:44 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:06:45.698937 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-31169e20-314e-4278-ab77-10e42a52fbf1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:45.699580 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-31169e20-314e-4278-ab77-10e42a52fbf1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:45.702030 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_cell0:SELECT=2 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:06:45.707090 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-31169e20-314e-4278-ab77-10e42a52fbf1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:45.707573 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-31169e20-314e-4278-ab77-10e42a52fbf1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:45.708055 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-31169e20-314e-4278-ab77-10e42a52fbf1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:45.708724 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-31169e20-314e-4278-ab77-10e42a52fbf1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:45.709176 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-31169e20-314e-4278-ab77-10e42a52fbf1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:45.709601 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-31169e20-314e-4278-ab77-10e42a52fbf1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:45.850330 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-31169e20-314e-4278-ab77-10e42a52fbf1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:45.860029 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-31169e20-314e-4278-ab77-10e42a52fbf1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:45.861540 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-31169e20-314e-4278-ab77-10e42a52fbf1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:45.862705 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-31169e20-314e-4278-ab77-10e42a52fbf1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 200 len: 1599 microversion: 2.20 time: 0.168287 Aug 09 07:06:45.863267 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 299/603] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:06:45 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 1599 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:06:45.888881 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-033ed86d-53bd-4fd3-8a8a-95b147fe8f17 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:45.889433 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-033ed86d-53bd-4fd3-8a8a-95b147fe8f17 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:45.891258 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=2 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:06:45.891931 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=10 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:06:45.898448 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-033ed86d-53bd-4fd3-8a8a-95b147fe8f17 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:45.898918 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-033ed86d-53bd-4fd3-8a8a-95b147fe8f17 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:45.899342 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-033ed86d-53bd-4fd3-8a8a-95b147fe8f17 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:45.900847 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-033ed86d-53bd-4fd3-8a8a-95b147fe8f17 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:45.901388 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-033ed86d-53bd-4fd3-8a8a-95b147fe8f17 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:45.901838 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-033ed86d-53bd-4fd3-8a8a-95b147fe8f17 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:45.980186 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-033ed86d-53bd-4fd3-8a8a-95b147fe8f17 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.095543 Aug 09 07:06:45.980777 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 305/604] 10.222.0.30 () {60 vars in 1316 bytes} [Tue Aug 9 07:06:45 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 07:06:47.139322 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [req-16a7508c-5c98-4308-b532-804f1c50c7d6 req-6d296f6b-717e-4c99-bba2-dde8076ac489 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf38e7a7-b39a-4966-aa2d-effc83a555b8", "tag": "067648c9-4dd9-4848-a425-3cbbac00eedd"}]} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:06:47.151256 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-16a7508c-5c98-4308-b532-804f1c50c7d6 req-6d296f6b-717e-4c99-bba2-dde8076ac489 service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:47.151769 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-16a7508c-5c98-4308-b532-804f1c50c7d6 req-6d296f6b-717e-4c99-bba2-dde8076ac489 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:47.152201 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-16a7508c-5c98-4308-b532-804f1c50c7d6 req-6d296f6b-717e-4c99-bba2-dde8076ac489 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:47.163032 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.compute.server_external_events [req-16a7508c-5c98-4308-b532-804f1c50c7d6 req-6d296f6b-717e-4c99-bba2-dde8076ac489 service nova] Creating event network-changed:067648c9-4dd9-4848-a425-3cbbac00eedd for instance cf38e7a7-b39a-4966-aa2d-effc83a555b8 on hv-cinder-85251 Aug 09 07:06:47.168744 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [req-16a7508c-5c98-4308-b532-804f1c50c7d6 req-6d296f6b-717e-4c99-bba2-dde8076ac489 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033027 Aug 09 07:06:47.169334 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 300/605] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:06:55.037490 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f47abd8a-d00d-4bde-b8ee-7d80f9237e7e tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:55.039714 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-f47abd8a-d00d-4bde-b8ee-7d80f9237e7e tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:55.046446 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f47abd8a-d00d-4bde-b8ee-7d80f9237e7e tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:55.046928 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f47abd8a-d00d-4bde-b8ee-7d80f9237e7e tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:55.047376 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f47abd8a-d00d-4bde-b8ee-7d80f9237e7e tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:55.048091 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f47abd8a-d00d-4bde-b8ee-7d80f9237e7e tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:55.048549 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f47abd8a-d00d-4bde-b8ee-7d80f9237e7e tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:55.048979 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f47abd8a-d00d-4bde-b8ee-7d80f9237e7e tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:55.077566 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f47abd8a-d00d-4bde-b8ee-7d80f9237e7e tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044682 Aug 09 07:06:55.078113 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 306/606] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 9 07:06:55 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 07:06:55.141160 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-c78cfd97-563f-4878-830c-5b1c4fcdc1e8 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:55.141729 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-c78cfd97-563f-4878-830c-5b1c4fcdc1e8 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:55.143613 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:06:55.149083 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c78cfd97-563f-4878-830c-5b1c4fcdc1e8 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:55.149591 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c78cfd97-563f-4878-830c-5b1c4fcdc1e8 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:55.150049 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c78cfd97-563f-4878-830c-5b1c4fcdc1e8 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:55.150728 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c78cfd97-563f-4878-830c-5b1c4fcdc1e8 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:55.151177 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c78cfd97-563f-4878-830c-5b1c4fcdc1e8 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:55.151607 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c78cfd97-563f-4878-830c-5b1c4fcdc1e8 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:55.176923 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-c78cfd97-563f-4878-830c-5b1c4fcdc1e8 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Going to try to terminate instance {{(pid=117858) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 07:06:55.252800 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-c78cfd97-563f-4878-830c-5b1c4fcdc1e8 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 204 len: 0 microversion: 2.1 time: 0.116122 Aug 09 07:06:55.253656 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 301/607] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 9 07:06:55 2022] DELETE /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 07:06:55.262992 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-7d61ef2e-0b25-47ce-bae1-8b01601c23bd tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:55.263618 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-7d61ef2e-0b25-47ce-bae1-8b01601c23bd tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:55.269607 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7d61ef2e-0b25-47ce-bae1-8b01601c23bd tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:55.270085 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7d61ef2e-0b25-47ce-bae1-8b01601c23bd tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:55.270515 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7d61ef2e-0b25-47ce-bae1-8b01601c23bd tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:55.271195 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7d61ef2e-0b25-47ce-bae1-8b01601c23bd tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:55.272349 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7d61ef2e-0b25-47ce-bae1-8b01601c23bd tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:55.272778 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7d61ef2e-0b25-47ce-bae1-8b01601c23bd tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:55.399958 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-7d61ef2e-0b25-47ce-bae1-8b01601c23bd tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:55.407415 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-7d61ef2e-0b25-47ce-bae1-8b01601c23bd tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1674 microversion: 2.1 time: 0.149192 Aug 09 07:06:55.408014 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 307/608] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:06:55 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1674 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:06:56.429883 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-45503d89-bee2-4401-90b9-498a5644c891 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:56.431053 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-45503d89-bee2-4401-90b9-498a5644c891 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:56.437645 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-45503d89-bee2-4401-90b9-498a5644c891 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:56.438126 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-45503d89-bee2-4401-90b9-498a5644c891 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:56.438560 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-45503d89-bee2-4401-90b9-498a5644c891 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:56.439246 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-45503d89-bee2-4401-90b9-498a5644c891 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:56.439729 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-45503d89-bee2-4401-90b9-498a5644c891 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:56.440160 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-45503d89-bee2-4401-90b9-498a5644c891 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:56.570986 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-45503d89-bee2-4401-90b9-498a5644c891 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:56.578457 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-45503d89-bee2-4401-90b9-498a5644c891 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1674 microversion: 2.1 time: 0.152885 Aug 09 07:06:56.579016 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 302/609] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:06:56 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:06:57.600678 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-86a1778c-c877-446a-a1c6-b14846523829 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:57.601415 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-86a1778c-c877-446a-a1c6-b14846523829 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:57.604558 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:06:57.609790 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-86a1778c-c877-446a-a1c6-b14846523829 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:57.610294 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-86a1778c-c877-446a-a1c6-b14846523829 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:57.610712 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-86a1778c-c877-446a-a1c6-b14846523829 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:57.611413 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-86a1778c-c877-446a-a1c6-b14846523829 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:57.611907 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-86a1778c-c877-446a-a1c6-b14846523829 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:57.612337 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-86a1778c-c877-446a-a1c6-b14846523829 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:57.745864 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-86a1778c-c877-446a-a1c6-b14846523829 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:57.753565 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-86a1778c-c877-446a-a1c6-b14846523829 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1674 microversion: 2.1 time: 0.156501 Aug 09 07:06:57.754137 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 308/610] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:06:57 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:06:58.575751 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [req-d831410b-fb3f-4d6c-8844-39ff976417ea req-408a6247-f432-4e6c-a78e-9aead8b69983 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46", "name": "network-vif-deleted", "tag": "8ca46829-e122-42ef-87e0-c5d0bd4f1294"}]} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:06:58.585380 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-d831410b-fb3f-4d6c-8844-39ff976417ea req-408a6247-f432-4e6c-a78e-9aead8b69983 service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:58.585861 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-d831410b-fb3f-4d6c-8844-39ff976417ea req-408a6247-f432-4e6c-a78e-9aead8b69983 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:58.586301 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-d831410b-fb3f-4d6c-8844-39ff976417ea req-408a6247-f432-4e6c-a78e-9aead8b69983 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:58.598490 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.compute.server_external_events [req-d831410b-fb3f-4d6c-8844-39ff976417ea req-408a6247-f432-4e6c-a78e-9aead8b69983 service nova] Creating event network-vif-deleted:8ca46829-e122-42ef-87e0-c5d0bd4f1294 for instance 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 on hv-cinder-85251 Aug 09 07:06:58.604787 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [req-d831410b-fb3f-4d6c-8844-39ff976417ea req-408a6247-f432-4e6c-a78e-9aead8b69983 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032558 Aug 09 07:06:58.605428 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 303/611] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:06:58.775446 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4f45f69c-263d-4238-9d35-7dfb5c518272 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:58.776184 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4f45f69c-263d-4238-9d35-7dfb5c518272 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:58.782994 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4f45f69c-263d-4238-9d35-7dfb5c518272 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:58.783482 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4f45f69c-263d-4238-9d35-7dfb5c518272 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:58.783954 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4f45f69c-263d-4238-9d35-7dfb5c518272 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:58.784654 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4f45f69c-263d-4238-9d35-7dfb5c518272 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:58.785113 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4f45f69c-263d-4238-9d35-7dfb5c518272 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:58.785543 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4f45f69c-263d-4238-9d35-7dfb5c518272 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:58.817856 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4f45f69c-263d-4238-9d35-7dfb5c518272 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:58.818360 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4f45f69c-263d-4238-9d35-7dfb5c518272 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:58.818786 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4f45f69c-263d-4238-9d35-7dfb5c518272 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:58.819231 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.objects.instance [None req-4f45f69c-263d-4238-9d35-7dfb5c518272 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lazy-loading 'fault' on Instance uuid 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 {{(pid=117859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 07:06:58.861669 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4f45f69c-263d-4238-9d35-7dfb5c518272 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:06:58.869233 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4f45f69c-263d-4238-9d35-7dfb5c518272 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 200 len: 1327 microversion: 2.1 time: 0.098309 Aug 09 07:06:58.870030 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 309/612] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:06:58 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 1327 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:06:59.241534 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-d40480d8-e86c-49b2-8be1-6c47ef68ac12 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:59.242044 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-d40480d8-e86c-49b2-8be1-6c47ef68ac12 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: eb8f3b26-f937-4677-b8f9-9208f68a0449] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:59.250444 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d40480d8-e86c-49b2-8be1-6c47ef68ac12 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:59.250929 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d40480d8-e86c-49b2-8be1-6c47ef68ac12 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:59.251363 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d40480d8-e86c-49b2-8be1-6c47ef68ac12 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:59.252094 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d40480d8-e86c-49b2-8be1-6c47ef68ac12 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:59.252546 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d40480d8-e86c-49b2-8be1-6c47ef68ac12 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:59.252978 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d40480d8-e86c-49b2-8be1-6c47ef68ac12 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:59.277234 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-d40480d8-e86c-49b2-8be1-6c47ef68ac12 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/eb8f3b26-f937-4677-b8f9-9208f68a0449/ips" status: 200 len: 149 microversion: 2.1 time: 0.039983 Aug 09 07:06:59.277813 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 304/613] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Aug 9 07:06:59 2022] GET /compute/v2.1/servers/eb8f3b26-f937-4677-b8f9-9208f68a0449/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:06:59.890812 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-7028b995-b75c-4576-8bc7-b6a31bf8cbac tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:59.891428 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-7028b995-b75c-4576-8bc7-b6a31bf8cbac tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:06:59.897978 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7028b995-b75c-4576-8bc7-b6a31bf8cbac tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:59.898457 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7028b995-b75c-4576-8bc7-b6a31bf8cbac tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:59.898891 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7028b995-b75c-4576-8bc7-b6a31bf8cbac tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:59.899578 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7028b995-b75c-4576-8bc7-b6a31bf8cbac tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:06:59.900057 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7028b995-b75c-4576-8bc7-b6a31bf8cbac tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:06:59.900485 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7028b995-b75c-4576-8bc7-b6a31bf8cbac tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:06:59.914385 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-7028b995-b75c-4576-8bc7-b6a31bf8cbac tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] HTTP exception thrown: Instance 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 could not be found. Aug 09 07:06:59.916029 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-7028b995-b75c-4576-8bc7-b6a31bf8cbac tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Request method failure captured: Aug 09 07:06:59.916029 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 HTTP/1.1 Aug 09 07:06:59.916029 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 09 07:06:59.916029 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 09 07:06:59.916029 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Connection: close Aug 09 07:06:59.916029 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Length: 0 Aug 09 07:06:59.916029 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 09 07:06:59.916029 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.30 Aug 09 07:06:59.916029 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 09 07:06:59.916029 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.11 Aug 09 07:06:59.916029 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi8gaPh4UD8Lvsts7n6cRYQXvOuIgw_ZpKGOaLWJmiZbPPEZm6jRgu3O-sdtpcq3g5nszKTXfwzuDu4siciDBluQpQob3JvdcaWweC2dNTEsiNm9r1lDGUUVuvJmpQzcw40bAADmfJbAvFpmuPblEml6zt8swHKHYmVIOErwAWIvlwC_A Aug 09 07:06:59.916029 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 09 07:06:59.916029 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 09 07:06:59.916029 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 09 07:06:59.916029 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 09 07:06:59.916029 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 09 07:06:59.916029 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 09 07:06:59.916029 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Id: b7ada2fd6ffa44df9345c13afb650496 Aug 09 07:06:59.916029 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-AttachVolumeTestJSON-1520792079 Aug 09 07:06:59.916029 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 09 07:06:59.916029 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 09 07:06:59.918399 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b7ada2fd6ffa44df9345c13afb650496"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b7ada2fd6ffa44df9345c13afb650496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b7ada2fd6ffa44df9345c13afb650496"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b7ada2fd6ffa44df9345c13afb650496"}]}] Aug 09 07:06:59.918399 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-AttachVolumeTestJSON-1520792079 Aug 09 07:06:59.918399 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: b7ada2fd6ffa44df9345c13afb650496 Aug 09 07:06:59.918399 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1520792079 Aug 09 07:06:59.918399 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User: tempest-AttachVolumeTestJSON-1520792079-project Aug 09 07:06:59.918399 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 09 07:06:59.918399 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 09 07:06:59.918399 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Id: 4e528f53a4b94e0fab0d90e0dbe07216 Aug 09 07:06:59.918399 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-AttachVolumeTestJSON-1520792079-project Aug 09 07:06:59.918399 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: method: > Aug 09 07:06:59.918399 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: exception: Instance 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 could not be found. Aug 09 07:06:59.918399 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: action_args: {'id': '1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46'} Aug 09 07:06:59.919180 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 07:06:59.919180 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:06:59.919180 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 07:06:59.919180 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 07:06:59.919180 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 07:06:59.919180 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 07:06:59.919180 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 07:06:59.919180 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 07:06:59.919180 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 07:06:59.919180 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 07:06:59.919180 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 could not be found. Aug 09 07:06:59.919180 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:06:59.919180 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:06:59.919180 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:06:59.919180 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:06:59.919180 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:06:59.919180 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:06:59.919180 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 07:06:59.919180 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 07:06:59.919180 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 07:06:59.920538 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 07:06:59.920538 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 07:06:59.920538 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 07:06:59.920538 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 07:06:59.920538 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 07:06:59.920538 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 07:06:59.920538 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 07:06:59.920538 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 could not be found. Aug 09 07:06:59.920538 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:06:59.920538 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:06:59.920538 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:06:59.920538 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:06:59.920538 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:06:59.920538 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:06:59.920538 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 07:06:59.920538 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 07:06:59.920538 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 could not be found. Aug 09 07:06:59.920538 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:06:59.921778 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-7028b995-b75c-4576-8bc7-b6a31bf8cbac tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Returning 404 to user: Instance 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 07:06:59.921778 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-7028b995-b75c-4576-8bc7-b6a31bf8cbac tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 404 len: 111 microversion: 2.1 time: 0.031141 Aug 09 07:06:59.921778 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 310/614] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:06:59 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 07:06:59.926924 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-ea7b57cd-9b8b-4035-881b-701b56adfda3 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '.version_select at 0x7f20ddbb2700>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:06:59.945335 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-ea7b57cd-9b8b-4035-881b-701b56adfda3 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2049758880" status: 202 len: 0 microversion: 2.1 time: 0.022180 Aug 09 07:06:59.945878 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 305/615] 10.222.0.30 () {58 vars in 1221 bytes} [Tue Aug 9 07:06:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2049758880 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 07:07:00.572327 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f7ec4da1-6912-48a8-8c44-02bfc172a7a5 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Action: 'create', calling method: .version_select at 0x7f20dd3314c0>, body: {"keypair": {"name": "tempest-keypair-235056689", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPC6FmMzKK075CkrHVEyegVLws3B37QB1skAVD/TCmStkQZUbpcfATXcmxx1Z7zneUHqweRZM0La9DKwwQeRlC6Mpx9RCpNYMY+UgPaanX+It7uA6cNSamlFl9USf6y+SA=="}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:07:00.587651 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-f7ec4da1-6912-48a8-8c44-02bfc172a7a5 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Getting quotas for project b7ada2fd6ffa44df9345c13afb650496. Resources: {'key_pairs'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 07:07:00.591579 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-f7ec4da1-6912-48a8-8c44-02bfc172a7a5 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Getting quotas for user 4e528f53a4b94e0fab0d90e0dbe07216 and project b7ada2fd6ffa44df9345c13afb650496. Resources: {'key_pairs'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 07:07:00.624957 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f7ec4da1-6912-48a8-8c44-02bfc172a7a5 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.056302 Aug 09 07:07:00.625166 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-54e1d222-b08a-4b66-8d33-88982b51c39b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7828c44b-0054-443b-b0cb-c4cb034d64e9"}} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:07:00.625592 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 311/616] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 9 07:07:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:07:00.627544 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-54e1d222-b08a-4b66-8d33-88982b51c39b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: eb8f3b26-f937-4677-b8f9-9208f68a0449] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:00.637072 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-54e1d222-b08a-4b66-8d33-88982b51c39b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:00.637555 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-54e1d222-b08a-4b66-8d33-88982b51c39b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:00.637993 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-54e1d222-b08a-4b66-8d33-88982b51c39b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:00.638692 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-54e1d222-b08a-4b66-8d33-88982b51c39b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:00.639142 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-54e1d222-b08a-4b66-8d33-88982b51c39b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:00.639565 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-54e1d222-b08a-4b66-8d33-88982b51c39b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:00.895628 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-54e1d222-b08a-4b66-8d33-88982b51c39b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "POST /compute/v2.1/servers/eb8f3b26-f937-4677-b8f9-9208f68a0449/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277427 Aug 09 07:07:00.896253 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 306/617] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Aug 9 07:07:00 2022] POST /compute/v2.1/servers/eb8f3b26-f937-4677-b8f9-9208f68a0449/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:07:01.929285 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-5a671f99-e8f9-4eea-a29a-7065232745b8 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-386382568", "imageRef": "5d2c35cc-2f3b-4a22-bd68-79c71882b6a2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4d897412-7520-4330-bf22-421d8f4aaa42"}], "security_groups": [{"name": "tempest-securitygroup--1405148416"}], "key_name": "tempest-keypair-235056689", "user_data": "}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:07:02.037351 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.network.neutron [None req-5a671f99-e8f9-4eea-a29a-7065232745b8 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] validate_networks() for [('4d897412-7520-4330-bf22-421d8f4aaa42', None, None, None, None, None)] {{(pid=117859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 07:07:02.405685 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-5a671f99-e8f9-4eea-a29a-7065232745b8 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Flavor limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 07:07:02.406107 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-5a671f99-e8f9-4eea-a29a-7065232745b8 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Image limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 07:07:02.406578 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-5a671f99-e8f9-4eea-a29a-7065232745b8 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Flavor pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 07:07:02.406979 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-5a671f99-e8f9-4eea-a29a-7065232745b8 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Image pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 07:07:02.407383 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-5a671f99-e8f9-4eea-a29a-7065232745b8 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 07:07:02.416128 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5a671f99-e8f9-4eea-a29a-7065232745b8 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:02.416589 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5a671f99-e8f9-4eea-a29a-7065232745b8 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:02.417016 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5a671f99-e8f9-4eea-a29a-7065232745b8 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:02.417727 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5a671f99-e8f9-4eea-a29a-7065232745b8 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:02.418291 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5a671f99-e8f9-4eea-a29a-7065232745b8 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:02.418886 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5a671f99-e8f9-4eea-a29a-7065232745b8 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:02.425410 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=82 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:07:02.437158 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-5a671f99-e8f9-4eea-a29a-7065232745b8 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Getting quotas for project b7ada2fd6ffa44df9345c13afb650496. Resources: {'cores', 'instances', 'ram'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 07:07:02.441003 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-5a671f99-e8f9-4eea-a29a-7065232745b8 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Getting quotas for user 4e528f53a4b94e0fab0d90e0dbe07216 and project b7ada2fd6ffa44df9345c13afb650496. Resources: {'cores', 'instances', 'ram'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 07:07:02.452280 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-5a671f99-e8f9-4eea-a29a-7065232745b8 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Going to run 1 instances... {{(pid=117859) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 07:07:02.454475 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-5a671f99-e8f9-4eea-a29a-7065232745b8 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: e7e5215b-7f52-4485-9995-10958c4c3006] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5d2c35cc-2f3b-4a22-bd68-79c71882b6a2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 07:07:02.498388 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-5a671f99-e8f9-4eea-a29a-7065232745b8 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.573899 Aug 09 07:07:02.499026 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 312/618] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 9 07:07:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 07:07:02.511096 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-89b7f93f-f658-44cb-896e-04e0c176fefb tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:02.512538 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-89b7f93f-f658-44cb-896e-04e0c176fefb tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: e7e5215b-7f52-4485-9995-10958c4c3006] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:02.566133 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-89b7f93f-f658-44cb-896e-04e0c176fefb tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:02.572750 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-89b7f93f-f658-44cb-896e-04e0c176fefb tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006" status: 200 len: 1236 microversion: 2.1 time: 0.066356 Aug 09 07:07:02.573320 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 307/619] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:07:02 2022] GET /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006 => generated 1236 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:07:03.593982 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4048afab-715e-4f24-a525-7d5e83b75dd2 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:03.595462 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4048afab-715e-4f24-a525-7d5e83b75dd2 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: e7e5215b-7f52-4485-9995-10958c4c3006] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:03.602395 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4048afab-715e-4f24-a525-7d5e83b75dd2 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:03.603133 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4048afab-715e-4f24-a525-7d5e83b75dd2 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:03.603583 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4048afab-715e-4f24-a525-7d5e83b75dd2 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:03.604311 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4048afab-715e-4f24-a525-7d5e83b75dd2 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:03.605057 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4048afab-715e-4f24-a525-7d5e83b75dd2 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:03.606453 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4048afab-715e-4f24-a525-7d5e83b75dd2 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:03.674046 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4048afab-715e-4f24-a525-7d5e83b75dd2 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:03.682060 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4048afab-715e-4f24-a525-7d5e83b75dd2 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006" status: 200 len: 1306 microversion: 2.1 time: 0.092403 Aug 09 07:07:03.682651 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 313/620] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:07:03 2022] GET /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006 => generated 1306 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:07:04.703239 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-b287a66b-28c3-4383-a8b8-379d39d2650d tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:04.703984 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-b287a66b-28c3-4383-a8b8-379d39d2650d tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: e7e5215b-7f52-4485-9995-10958c4c3006] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:04.711228 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b287a66b-28c3-4383-a8b8-379d39d2650d tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:04.711747 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b287a66b-28c3-4383-a8b8-379d39d2650d tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:04.712181 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b287a66b-28c3-4383-a8b8-379d39d2650d tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:04.712870 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b287a66b-28c3-4383-a8b8-379d39d2650d tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:04.713319 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b287a66b-28c3-4383-a8b8-379d39d2650d tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:04.713744 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b287a66b-28c3-4383-a8b8-379d39d2650d tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:04.859064 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-b287a66b-28c3-4383-a8b8-379d39d2650d tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:04.862479 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-5616ba27-6ad9-4f48-8e44-86db2fc8d2d8 req-281b7484-7eca-43fa-9c13-9521d19fc9cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7e5215b-7f52-4485-9995-10958c4c3006", "tag": "c73267b0-26d4-4dbf-9245-98ec45d37c2c"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:07:04.863187 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-b287a66b-28c3-4383-a8b8-379d39d2650d tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006" status: 200 len: 1362 microversion: 2.1 time: 0.164571 Aug 09 07:07:04.863940 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 308/621] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:07:04 2022] GET /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:07:04.878471 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-5616ba27-6ad9-4f48-8e44-86db2fc8d2d8 req-281b7484-7eca-43fa-9c13-9521d19fc9cc service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:04.879233 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-5616ba27-6ad9-4f48-8e44-86db2fc8d2d8 req-281b7484-7eca-43fa-9c13-9521d19fc9cc service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:04.879704 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-5616ba27-6ad9-4f48-8e44-86db2fc8d2d8 req-281b7484-7eca-43fa-9c13-9521d19fc9cc service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:04.894836 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-5616ba27-6ad9-4f48-8e44-86db2fc8d2d8 req-281b7484-7eca-43fa-9c13-9521d19fc9cc service nova] Creating event network-changed:c73267b0-26d4-4dbf-9245-98ec45d37c2c for instance e7e5215b-7f52-4485-9995-10958c4c3006 on hv-cinder-85251 Aug 09 07:07:04.899800 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-5616ba27-6ad9-4f48-8e44-86db2fc8d2d8 req-281b7484-7eca-43fa-9c13-9521d19fc9cc service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047471 Aug 09 07:07:04.900407 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 314/622] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 07:07:05.884973 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-71b21cfd-d926-4a29-8e74-01ee87a58b83 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:05.885594 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-71b21cfd-d926-4a29-8e74-01ee87a58b83 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: e7e5215b-7f52-4485-9995-10958c4c3006] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:05.892369 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-71b21cfd-d926-4a29-8e74-01ee87a58b83 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:05.892859 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-71b21cfd-d926-4a29-8e74-01ee87a58b83 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:05.893297 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-71b21cfd-d926-4a29-8e74-01ee87a58b83 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:05.893990 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-71b21cfd-d926-4a29-8e74-01ee87a58b83 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:05.894554 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-71b21cfd-d926-4a29-8e74-01ee87a58b83 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:05.894989 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-71b21cfd-d926-4a29-8e74-01ee87a58b83 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:06.022148 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-71b21cfd-d926-4a29-8e74-01ee87a58b83 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:06.029965 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-71b21cfd-d926-4a29-8e74-01ee87a58b83 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006" status: 200 len: 1362 microversion: 2.1 time: 0.148846 Aug 09 07:07:06.030520 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 309/623] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:07:05 2022] GET /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006 => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:07:07.051184 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-bc7056d0-91e4-4455-a216-8dbb13d780ad tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:07.051908 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-bc7056d0-91e4-4455-a216-8dbb13d780ad tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: e7e5215b-7f52-4485-9995-10958c4c3006] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:07.058422 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bc7056d0-91e4-4455-a216-8dbb13d780ad tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:07.059536 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bc7056d0-91e4-4455-a216-8dbb13d780ad tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:07.059991 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bc7056d0-91e4-4455-a216-8dbb13d780ad tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:07.060671 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bc7056d0-91e4-4455-a216-8dbb13d780ad tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:07.061123 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bc7056d0-91e4-4455-a216-8dbb13d780ad tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:07.061539 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bc7056d0-91e4-4455-a216-8dbb13d780ad tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:07.192260 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-bc7056d0-91e4-4455-a216-8dbb13d780ad tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:07.199740 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-bc7056d0-91e4-4455-a216-8dbb13d780ad tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006" status: 200 len: 1362 microversion: 2.1 time: 0.152794 Aug 09 07:07:07.200301 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 315/624] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:07:07 2022] GET /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:07:08.220826 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-966f25dc-77c0-4106-9b6b-a63a3c82bde8 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:08.221432 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-966f25dc-77c0-4106-9b6b-a63a3c82bde8 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: e7e5215b-7f52-4485-9995-10958c4c3006] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:08.227784 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-966f25dc-77c0-4106-9b6b-a63a3c82bde8 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:08.228260 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-966f25dc-77c0-4106-9b6b-a63a3c82bde8 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:08.228686 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-966f25dc-77c0-4106-9b6b-a63a3c82bde8 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:08.229357 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-966f25dc-77c0-4106-9b6b-a63a3c82bde8 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:08.229801 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-966f25dc-77c0-4106-9b6b-a63a3c82bde8 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:08.230262 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-966f25dc-77c0-4106-9b6b-a63a3c82bde8 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:08.233046 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:07:08.360673 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-966f25dc-77c0-4106-9b6b-a63a3c82bde8 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:08.368043 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-966f25dc-77c0-4106-9b6b-a63a3c82bde8 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006" status: 200 len: 1362 microversion: 2.1 time: 0.151036 Aug 09 07:07:08.368607 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 310/625] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:07:08 2022] GET /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:07:08.460695 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-5f6e1bbc-cf3d-40de-9ba2-f0db8d5a131b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7828c44b-0054-443b-b0cb-c4cb034d64e9"}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:07:08.463034 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-5f6e1bbc-cf3d-40de-9ba2-f0db8d5a131b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: eb8f3b26-f937-4677-b8f9-9208f68a0449] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:08.469960 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5f6e1bbc-cf3d-40de-9ba2-f0db8d5a131b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:08.470440 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5f6e1bbc-cf3d-40de-9ba2-f0db8d5a131b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:08.470873 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5f6e1bbc-cf3d-40de-9ba2-f0db8d5a131b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:08.471554 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5f6e1bbc-cf3d-40de-9ba2-f0db8d5a131b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:08.472033 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5f6e1bbc-cf3d-40de-9ba2-f0db8d5a131b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:08.472460 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5f6e1bbc-cf3d-40de-9ba2-f0db8d5a131b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:08.549126 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-5f6e1bbc-cf3d-40de-9ba2-f0db8d5a131b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] HTTP exception thrown: Invalid volume: volume 7828c44b-0054-443b-b0cb-c4cb034d64e9 is already attached to instances: eb8f3b26-f937-4677-b8f9-9208f68a0449 Aug 09 07:07:08.550853 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-5f6e1bbc-cf3d-40de-9ba2-f0db8d5a131b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Request method failure captured: Aug 09 07:07:08.550853 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: request: POST /compute/v2.1/servers/eb8f3b26-f937-4677-b8f9-9208f68a0449/os-volume_attachments HTTP/1.1 Aug 09 07:07:08.550853 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 09 07:07:08.550853 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 09 07:07:08.550853 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Connection: close Aug 09 07:07:08.550853 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Length: 74 Aug 09 07:07:08.550853 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 09 07:07:08.550853 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.30 Aug 09 07:07:08.550853 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 09 07:07:08.550853 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.11 Aug 09 07:07:08.550853 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi8gaG96fR8jlKQ8TiHSUILZSO2wcQMYr69tPNs3VsPdBbduE5q2N89Qfor1fKdUNuu3cU5AkFy4zL1QPl7jYp6fw9XYg8hg0IW6MscBdP4L-HtUgUgXdSQOw3p3as0Mug0wzwISkStMEUz2JvWC4HKwrWVHwt0TNvR0CveB6NheFq7RI Aug 09 07:07:08.550853 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 09 07:07:08.550853 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 09 07:07:08.550853 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 09 07:07:08.550853 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 09 07:07:08.550853 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 09 07:07:08.550853 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 09 07:07:08.550853 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Id: f38c6aa37b9643bbbe5bb7fd3efde4fd Aug 09 07:07:08.550853 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-AttachVolumeNegativeTest-2082484098 Aug 09 07:07:08.550853 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 09 07:07:08.550853 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 09 07:07:08.552437 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f38c6aa37b9643bbbe5bb7fd3efde4fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f38c6aa37b9643bbbe5bb7fd3efde4fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f38c6aa37b9643bbbe5bb7fd3efde4fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f38c6aa37b9643bbbe5bb7fd3efde4fd"}]}] Aug 09 07:07:08.552437 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-AttachVolumeNegativeTest-2082484098 Aug 09 07:07:08.552437 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: f38c6aa37b9643bbbe5bb7fd3efde4fd Aug 09 07:07:08.552437 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2082484098 Aug 09 07:07:08.552437 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User: tempest-AttachVolumeNegativeTest-2082484098-project Aug 09 07:07:08.552437 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 09 07:07:08.552437 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 09 07:07:08.552437 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Id: cc885026afe041cca086367bb67d8a9b Aug 09 07:07:08.552437 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-AttachVolumeNegativeTest-2082484098-project Aug 09 07:07:08.552437 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Aug 09 07:07:08.552437 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: {"volumeAttachment": {"volumeId": "7828c44b-0054-443b-b0cb-c4cb034d64e9"}} Aug 09 07:07:08.552437 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: method: > Aug 09 07:07:08.555933 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: exception: Invalid volume: volume 7828c44b-0054-443b-b0cb-c4cb034d64e9 is already attached to instances: eb8f3b26-f937-4677-b8f9-9208f68a0449 Aug 09 07:07:08.555933 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: action_args: {'server_id': 'eb8f3b26-f937-4677-b8f9-9208f68a0449', 'body': {'volumeAttachment': {'volumeId': '7828c44b-0054-443b-b0cb-c4cb034d64e9'}}} Aug 09 07:07:08.555933 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 07:07:08.555933 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:07:08.555933 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 09 07:07:08.555933 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 09 07:07:08.555933 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 09 07:07:08.555933 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 09 07:07:08.555933 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 09 07:07:08.555933 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 09 07:07:08.555933 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 09 07:07:08.555933 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 09 07:07:08.555933 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 09 07:07:08.555933 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 09 07:07:08.555933 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 7828c44b-0054-443b-b0cb-c4cb034d64e9 is already attached to instances: eb8f3b26-f937-4677-b8f9-9208f68a0449 Aug 09 07:07:08.555933 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:07:08.555933 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:07:08.555933 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:07:08.555933 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:07:08.557298 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:07:08.557298 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:07:08.557298 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 07:07:08.557298 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 07:07:08.557298 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 07:07:08.557298 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 07:07:08.557298 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 07:07:08.557298 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 07:07:08.557298 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 07:07:08.557298 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 07:07:08.557298 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 09 07:07:08.557298 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 09 07:07:08.557298 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 09 07:07:08.557298 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 09 07:07:08.557298 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 7828c44b-0054-443b-b0cb-c4cb034d64e9 is already attached to instances: eb8f3b26-f937-4677-b8f9-9208f68a0449 Aug 09 07:07:08.557298 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:07:08.557298 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:07:08.557298 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:07:08.557298 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:07:08.557298 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:07:08.559289 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:07:08.559289 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 07:07:08.559289 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 07:07:08.559289 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 7828c44b-0054-443b-b0cb-c4cb034d64e9 is already attached to instances: eb8f3b26-f937-4677-b8f9-9208f68a0449 Aug 09 07:07:08.559289 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:07:08.559289 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-5f6e1bbc-cf3d-40de-9ba2-f0db8d5a131b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Returning 400 to user: Invalid volume: volume 7828c44b-0054-443b-b0cb-c4cb034d64e9 is already attached to instances: eb8f3b26-f937-4677-b8f9-9208f68a0449 {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 07:07:08.559289 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-5f6e1bbc-cf3d-40de-9ba2-f0db8d5a131b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "POST /compute/v2.1/servers/eb8f3b26-f937-4677-b8f9-9208f68a0449/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095568 Aug 09 07:07:08.559289 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 316/626] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Aug 9 07:07:08 2022] POST /compute/v2.1/servers/eb8f3b26-f937-4677-b8f9-9208f68a0449/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 09 07:07:08.616925 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-a1ea8597-90ab-4f4f-ab9f-8ba8c412eae0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:08.617445 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-a1ea8597-90ab-4f4f-ab9f-8ba8c412eae0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: eb8f3b26-f937-4677-b8f9-9208f68a0449] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:08.624276 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a1ea8597-90ab-4f4f-ab9f-8ba8c412eae0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:08.624791 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a1ea8597-90ab-4f4f-ab9f-8ba8c412eae0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:08.625243 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a1ea8597-90ab-4f4f-ab9f-8ba8c412eae0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:08.625935 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a1ea8597-90ab-4f4f-ab9f-8ba8c412eae0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:08.626510 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a1ea8597-90ab-4f4f-ab9f-8ba8c412eae0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:08.626924 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a1ea8597-90ab-4f4f-ab9f-8ba8c412eae0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:08.706007 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.objects.instance [None req-a1ea8597-90ab-4f4f-ab9f-8ba8c412eae0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lazy-loading 'services' on Instance uuid eb8f3b26-f937-4677-b8f9-9208f68a0449 {{(pid=117858) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 07:07:08.820364 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-a1ea8597-90ab-4f4f-ab9f-8ba8c412eae0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "DELETE /compute/v2.1/servers/eb8f3b26-f937-4677-b8f9-9208f68a0449/os-volume_attachments/7828c44b-0054-443b-b0cb-c4cb034d64e9" status: 202 len: 0 microversion: 2.1 time: 0.206742 Aug 09 07:07:08.820996 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 311/627] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Aug 9 07:07:08 2022] DELETE /compute/v2.1/servers/eb8f3b26-f937-4677-b8f9-9208f68a0449/os-volume_attachments/7828c44b-0054-443b-b0cb-c4cb034d64e9 => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 07:07:08.831758 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-dcf91597-2931-424c-b8f9-37ff0cd2a42a tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:08.834134 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-dcf91597-2931-424c-b8f9-37ff0cd2a42a tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: eb8f3b26-f937-4677-b8f9-9208f68a0449] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:08.843993 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dcf91597-2931-424c-b8f9-37ff0cd2a42a tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:08.844479 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dcf91597-2931-424c-b8f9-37ff0cd2a42a tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:08.844946 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dcf91597-2931-424c-b8f9-37ff0cd2a42a tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:08.845641 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dcf91597-2931-424c-b8f9-37ff0cd2a42a tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:08.846092 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dcf91597-2931-424c-b8f9-37ff0cd2a42a tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:08.846509 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dcf91597-2931-424c-b8f9-37ff0cd2a42a tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:08.880075 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-dcf91597-2931-424c-b8f9-37ff0cd2a42a tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/eb8f3b26-f937-4677-b8f9-9208f68a0449/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052605 Aug 09 07:07:08.880661 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 317/628] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 9 07:07:08 2022] GET /compute/v2.1/servers/eb8f3b26-f937-4677-b8f9-9208f68a0449/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:07:08.949806 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [req-6825235b-c711-428f-ac1e-8306f8a6457c req-6f611433-c750-45ef-8199-0e405ee9347f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7e5215b-7f52-4485-9995-10958c4c3006", "name": "network-vif-plugged", "status": "completed", "tag": "c73267b0-26d4-4dbf-9245-98ec45d37c2c"}]} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:07:08.960496 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-6825235b-c711-428f-ac1e-8306f8a6457c req-6f611433-c750-45ef-8199-0e405ee9347f service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:08.960994 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-6825235b-c711-428f-ac1e-8306f8a6457c req-6f611433-c750-45ef-8199-0e405ee9347f service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:08.961426 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-6825235b-c711-428f-ac1e-8306f8a6457c req-6f611433-c750-45ef-8199-0e405ee9347f service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:08.974409 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.compute.server_external_events [req-6825235b-c711-428f-ac1e-8306f8a6457c req-6f611433-c750-45ef-8199-0e405ee9347f service nova] Creating event network-vif-plugged:c73267b0-26d4-4dbf-9245-98ec45d37c2c for instance e7e5215b-7f52-4485-9995-10958c4c3006 on hv-cinder-85251 Aug 09 07:07:08.979117 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [req-6825235b-c711-428f-ac1e-8306f8a6457c req-6f611433-c750-45ef-8199-0e405ee9347f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034044 Aug 09 07:07:08.979919 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 312/629] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 07:07:09.389938 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-99d234b3-7d78-44fe-a092-db9674bae61e tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:09.390802 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-99d234b3-7d78-44fe-a092-db9674bae61e tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: e7e5215b-7f52-4485-9995-10958c4c3006] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:09.396908 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-99d234b3-7d78-44fe-a092-db9674bae61e tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:09.397359 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-99d234b3-7d78-44fe-a092-db9674bae61e tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:09.397786 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-99d234b3-7d78-44fe-a092-db9674bae61e tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:09.398493 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-99d234b3-7d78-44fe-a092-db9674bae61e tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:09.398983 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-99d234b3-7d78-44fe-a092-db9674bae61e tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:09.399402 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-99d234b3-7d78-44fe-a092-db9674bae61e tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:09.532707 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-99d234b3-7d78-44fe-a092-db9674bae61e tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:09.540882 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-99d234b3-7d78-44fe-a092-db9674bae61e tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006" status: 200 len: 1362 microversion: 2.1 time: 0.154927 Aug 09 07:07:09.541436 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 318/630] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:07:09 2022] GET /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:07:09.893433 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-0bcfff2e-0eb9-4570-afbc-f92e94d018d8 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:09.895778 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-0bcfff2e-0eb9-4570-afbc-f92e94d018d8 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: eb8f3b26-f937-4677-b8f9-9208f68a0449] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:09.901904 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0bcfff2e-0eb9-4570-afbc-f92e94d018d8 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:09.902937 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0bcfff2e-0eb9-4570-afbc-f92e94d018d8 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:09.903442 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0bcfff2e-0eb9-4570-afbc-f92e94d018d8 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:09.904171 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0bcfff2e-0eb9-4570-afbc-f92e94d018d8 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:09.904623 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0bcfff2e-0eb9-4570-afbc-f92e94d018d8 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:09.905048 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0bcfff2e-0eb9-4570-afbc-f92e94d018d8 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:09.933559 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-0bcfff2e-0eb9-4570-afbc-f92e94d018d8 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/eb8f3b26-f937-4677-b8f9-9208f68a0449/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044916 Aug 09 07:07:09.934107 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 313/631] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 9 07:07:09 2022] GET /compute/v2.1/servers/eb8f3b26-f937-4677-b8f9-9208f68a0449/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 07:07:09.993942 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e2a2f126-3a18-4dd4-b075-bc2a7360299d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:09.994431 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-e2a2f126-3a18-4dd4-b075-bc2a7360299d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: eb8f3b26-f937-4677-b8f9-9208f68a0449] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:10.000515 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e2a2f126-3a18-4dd4-b075-bc2a7360299d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:10.000993 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e2a2f126-3a18-4dd4-b075-bc2a7360299d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:10.001423 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e2a2f126-3a18-4dd4-b075-bc2a7360299d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:10.002101 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e2a2f126-3a18-4dd4-b075-bc2a7360299d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:10.002544 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e2a2f126-3a18-4dd4-b075-bc2a7360299d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:10.003232 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e2a2f126-3a18-4dd4-b075-bc2a7360299d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:10.028894 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-e2a2f126-3a18-4dd4-b075-bc2a7360299d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: eb8f3b26-f937-4677-b8f9-9208f68a0449] Going to try to terminate instance {{(pid=117859) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 07:07:10.102478 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-e2a2f126-3a18-4dd4-b075-bc2a7360299d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "DELETE /compute/v2.1/servers/eb8f3b26-f937-4677-b8f9-9208f68a0449" status: 204 len: 0 microversion: 2.1 time: 0.112109 Aug 09 07:07:10.103047 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 319/632] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 9 07:07:09 2022] DELETE /compute/v2.1/servers/eb8f3b26-f937-4677-b8f9-9208f68a0449 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 07:07:10.111363 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-f7aca46c-bcf4-47d3-b958-e56350c27bc7 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:10.111941 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-f7aca46c-bcf4-47d3-b958-e56350c27bc7 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: eb8f3b26-f937-4677-b8f9-9208f68a0449] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:10.117804 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f7aca46c-bcf4-47d3-b958-e56350c27bc7 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:10.118290 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f7aca46c-bcf4-47d3-b958-e56350c27bc7 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:10.118729 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f7aca46c-bcf4-47d3-b958-e56350c27bc7 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:10.119424 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f7aca46c-bcf4-47d3-b958-e56350c27bc7 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:10.119903 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f7aca46c-bcf4-47d3-b958-e56350c27bc7 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:10.120336 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f7aca46c-bcf4-47d3-b958-e56350c27bc7 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:10.251562 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-f7aca46c-bcf4-47d3-b958-e56350c27bc7 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:10.259560 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-f7aca46c-bcf4-47d3-b958-e56350c27bc7 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/eb8f3b26-f937-4677-b8f9-9208f68a0449" status: 200 len: 1682 microversion: 2.1 time: 0.152217 Aug 09 07:07:10.260163 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 314/633] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:07:10 2022] GET /compute/v2.1/servers/eb8f3b26-f937-4677-b8f9-9208f68a0449 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:07:10.563293 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-39cc0537-83ad-48d6-a675-2b0ce5a00902 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:10.564028 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-39cc0537-83ad-48d6-a675-2b0ce5a00902 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: e7e5215b-7f52-4485-9995-10958c4c3006] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:10.570385 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-39cc0537-83ad-48d6-a675-2b0ce5a00902 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:10.570867 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-39cc0537-83ad-48d6-a675-2b0ce5a00902 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:10.571304 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-39cc0537-83ad-48d6-a675-2b0ce5a00902 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:10.572021 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-39cc0537-83ad-48d6-a675-2b0ce5a00902 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:10.572479 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-39cc0537-83ad-48d6-a675-2b0ce5a00902 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:10.572903 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-39cc0537-83ad-48d6-a675-2b0ce5a00902 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:10.701951 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-39cc0537-83ad-48d6-a675-2b0ce5a00902 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:10.709429 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-39cc0537-83ad-48d6-a675-2b0ce5a00902 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006" status: 200 len: 1362 microversion: 2.1 time: 0.150877 Aug 09 07:07:10.709993 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 320/634] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:07:10 2022] GET /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:07:11.282567 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-b5453190-e1db-4d87-8a2c-400391de8ac5 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:11.283168 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-b5453190-e1db-4d87-8a2c-400391de8ac5 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: eb8f3b26-f937-4677-b8f9-9208f68a0449] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:11.289532 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b5453190-e1db-4d87-8a2c-400391de8ac5 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:11.290008 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b5453190-e1db-4d87-8a2c-400391de8ac5 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:11.290440 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b5453190-e1db-4d87-8a2c-400391de8ac5 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:11.291114 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b5453190-e1db-4d87-8a2c-400391de8ac5 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:11.291558 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b5453190-e1db-4d87-8a2c-400391de8ac5 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:11.292001 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b5453190-e1db-4d87-8a2c-400391de8ac5 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:11.421277 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-b5453190-e1db-4d87-8a2c-400391de8ac5 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:11.428742 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-b5453190-e1db-4d87-8a2c-400391de8ac5 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/eb8f3b26-f937-4677-b8f9-9208f68a0449" status: 200 len: 1682 microversion: 2.1 time: 0.150106 Aug 09 07:07:11.429309 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 315/635] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:07:11 2022] GET /compute/v2.1/servers/eb8f3b26-f937-4677-b8f9-9208f68a0449 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:07:11.729113 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-7355bfde-f64c-448d-b516-3cc7d34a9437 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:11.729727 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-7355bfde-f64c-448d-b516-3cc7d34a9437 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: e7e5215b-7f52-4485-9995-10958c4c3006] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:11.736126 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7355bfde-f64c-448d-b516-3cc7d34a9437 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:11.736607 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7355bfde-f64c-448d-b516-3cc7d34a9437 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:11.737044 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7355bfde-f64c-448d-b516-3cc7d34a9437 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:11.737761 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7355bfde-f64c-448d-b516-3cc7d34a9437 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:11.738215 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7355bfde-f64c-448d-b516-3cc7d34a9437 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:11.738641 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7355bfde-f64c-448d-b516-3cc7d34a9437 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:11.867943 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-7355bfde-f64c-448d-b516-3cc7d34a9437 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:11.876339 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-7355bfde-f64c-448d-b516-3cc7d34a9437 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006" status: 200 len: 1362 microversion: 2.1 time: 0.151031 Aug 09 07:07:11.876902 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 321/636] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:07:11 2022] GET /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:07:12.331069 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-de268bf4-d0f6-4f0b-9034-fe4626ca5dee tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:12.331576 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-de268bf4-d0f6-4f0b-9034-fe4626ca5dee tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 51b65dde-1fef-4daa-9475-7609ac03dbc3] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:12.338008 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-de268bf4-d0f6-4f0b-9034-fe4626ca5dee tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:12.338499 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-de268bf4-d0f6-4f0b-9034-fe4626ca5dee tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:12.338944 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-de268bf4-d0f6-4f0b-9034-fe4626ca5dee tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:12.340299 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-de268bf4-d0f6-4f0b-9034-fe4626ca5dee tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:12.340785 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-de268bf4-d0f6-4f0b-9034-fe4626ca5dee tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:12.341286 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-de268bf4-d0f6-4f0b-9034-fe4626ca5dee tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:12.419758 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.objects.instance [None req-de268bf4-d0f6-4f0b-9034-fe4626ca5dee tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lazy-loading 'services' on Instance uuid 51b65dde-1fef-4daa-9475-7609ac03dbc3 {{(pid=117858) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 07:07:12.450093 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-38ecc823-e913-405a-805f-f5ce3080b63f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:12.450708 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-38ecc823-e913-405a-805f-f5ce3080b63f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: eb8f3b26-f937-4677-b8f9-9208f68a0449] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:12.452694 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=2 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:07:12.453455 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=10 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:07:12.459882 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-38ecc823-e913-405a-805f-f5ce3080b63f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:12.460398 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-38ecc823-e913-405a-805f-f5ce3080b63f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:12.460836 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-38ecc823-e913-405a-805f-f5ce3080b63f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:12.461560 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-38ecc823-e913-405a-805f-f5ce3080b63f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:12.461990 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-38ecc823-e913-405a-805f-f5ce3080b63f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:12.462412 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-38ecc823-e913-405a-805f-f5ce3080b63f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:12.497409 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-de268bf4-d0f6-4f0b-9034-fe4626ca5dee tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "DELETE /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3/os-volume_attachments/3249df34-5152-4d22-9b99-9b04ffa27706" status: 202 len: 0 microversion: 2.1 time: 0.170118 Aug 09 07:07:12.499645 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 316/637] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Aug 9 07:07:12 2022] DELETE /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3/os-volume_attachments/3249df34-5152-4d22-9b99-9b04ffa27706 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 07:07:12.507077 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-3f2f33f2-b9ff-4c2d-808d-70860d815121 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:12.509419 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-3f2f33f2-b9ff-4c2d-808d-70860d815121 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 51b65dde-1fef-4daa-9475-7609ac03dbc3] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:12.516866 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3f2f33f2-b9ff-4c2d-808d-70860d815121 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:12.517351 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3f2f33f2-b9ff-4c2d-808d-70860d815121 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:12.517795 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3f2f33f2-b9ff-4c2d-808d-70860d815121 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:12.518477 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3f2f33f2-b9ff-4c2d-808d-70860d815121 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:12.518923 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3f2f33f2-b9ff-4c2d-808d-70860d815121 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:12.519342 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3f2f33f2-b9ff-4c2d-808d-70860d815121 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:12.561975 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-3f2f33f2-b9ff-4c2d-808d-70860d815121 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059237 Aug 09 07:07:12.562616 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 317/638] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 9 07:07:12 2022] GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 07:07:12.616022 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-38ecc823-e913-405a-805f-f5ce3080b63f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:12.625453 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-38ecc823-e913-405a-805f-f5ce3080b63f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/eb8f3b26-f937-4677-b8f9-9208f68a0449" status: 200 len: 1682 microversion: 2.1 time: 0.179560 Aug 09 07:07:12.627628 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 322/639] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:07:12 2022] GET /compute/v2.1/servers/eb8f3b26-f937-4677-b8f9-9208f68a0449 => generated 1682 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:07:12.898198 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-0bb29e99-05f6-4fc0-b72b-db1ce1ee7738 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:12.898815 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-0bb29e99-05f6-4fc0-b72b-db1ce1ee7738 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: e7e5215b-7f52-4485-9995-10958c4c3006] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:12.900764 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_cell0:SELECT=2 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:07:12.906752 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0bb29e99-05f6-4fc0-b72b-db1ce1ee7738 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:12.907254 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0bb29e99-05f6-4fc0-b72b-db1ce1ee7738 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:12.907715 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0bb29e99-05f6-4fc0-b72b-db1ce1ee7738 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:12.908483 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0bb29e99-05f6-4fc0-b72b-db1ce1ee7738 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:12.909020 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0bb29e99-05f6-4fc0-b72b-db1ce1ee7738 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:12.909562 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0bb29e99-05f6-4fc0-b72b-db1ce1ee7738 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:13.052265 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-0bb29e99-05f6-4fc0-b72b-db1ce1ee7738 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:13.061310 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-0bb29e99-05f6-4fc0-b72b-db1ce1ee7738 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006" status: 200 len: 1548 microversion: 2.1 time: 0.166765 Aug 09 07:07:13.075628 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 318/640] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:07:12 2022] GET /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006 => generated 1548 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:07:13.089021 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-84e7c541-3e7b-4252-b8d7-202c0ad32df4 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:13.090107 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-84e7c541-3e7b-4252-b8d7-202c0ad32df4 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: e7e5215b-7f52-4485-9995-10958c4c3006] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:13.099696 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-84e7c541-3e7b-4252-b8d7-202c0ad32df4 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:13.103575 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-84e7c541-3e7b-4252-b8d7-202c0ad32df4 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:13.105495 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-84e7c541-3e7b-4252-b8d7-202c0ad32df4 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:13.106346 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-84e7c541-3e7b-4252-b8d7-202c0ad32df4 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:13.106852 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-84e7c541-3e7b-4252-b8d7-202c0ad32df4 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:13.107291 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-84e7c541-3e7b-4252-b8d7-202c0ad32df4 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:13.186981 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-84e7c541-3e7b-4252-b8d7-202c0ad32df4 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101776 Aug 09 07:07:13.187578 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 323/641] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Aug 9 07:07:13 2022] GET /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:07:13.369079 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [req-8864656c-b1a0-4a8e-99a7-18d72c1a8cfe req-1a9d7e7c-d2e8-4d4a-b6c4-b4ec82e8872e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb8f3b26-f937-4677-b8f9-9208f68a0449", "name": "network-vif-deleted", "tag": "9a48b6aa-872a-4373-8b0a-0da98fa36ff4"}]} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:07:13.380673 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-8864656c-b1a0-4a8e-99a7-18d72c1a8cfe req-1a9d7e7c-d2e8-4d4a-b6c4-b4ec82e8872e service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:13.381415 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-8864656c-b1a0-4a8e-99a7-18d72c1a8cfe req-1a9d7e7c-d2e8-4d4a-b6c4-b4ec82e8872e service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:13.382064 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-8864656c-b1a0-4a8e-99a7-18d72c1a8cfe req-1a9d7e7c-d2e8-4d4a-b6c4-b4ec82e8872e service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:13.396260 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.compute.server_external_events [req-8864656c-b1a0-4a8e-99a7-18d72c1a8cfe req-1a9d7e7c-d2e8-4d4a-b6c4-b4ec82e8872e service nova] Creating event network-vif-deleted:9a48b6aa-872a-4373-8b0a-0da98fa36ff4 for instance eb8f3b26-f937-4677-b8f9-9208f68a0449 on hv-cinder-85251 Aug 09 07:07:13.401942 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [req-8864656c-b1a0-4a8e-99a7-18d72c1a8cfe req-1a9d7e7c-d2e8-4d4a-b6c4-b4ec82e8872e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036593 Aug 09 07:07:13.403054 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 319/642] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 07:07:13.575208 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-244da13b-04a5-4587-a624-68d602a205a9 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:13.577419 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-244da13b-04a5-4587-a624-68d602a205a9 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 51b65dde-1fef-4daa-9475-7609ac03dbc3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:13.584430 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-244da13b-04a5-4587-a624-68d602a205a9 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:13.584916 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-244da13b-04a5-4587-a624-68d602a205a9 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:13.585351 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-244da13b-04a5-4587-a624-68d602a205a9 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:13.586054 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-244da13b-04a5-4587-a624-68d602a205a9 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:13.586505 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-244da13b-04a5-4587-a624-68d602a205a9 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:13.586936 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-244da13b-04a5-4587-a624-68d602a205a9 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:13.628540 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-244da13b-04a5-4587-a624-68d602a205a9 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057436 Aug 09 07:07:13.629432 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 324/643] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 9 07:07:13 2022] GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 07:07:13.650317 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-3098e7e5-8be9-40b9-af3a-a0511ed64a8f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:13.651644 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-3098e7e5-8be9-40b9-af3a-a0511ed64a8f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: eb8f3b26-f937-4677-b8f9-9208f68a0449] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:13.662155 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3098e7e5-8be9-40b9-af3a-a0511ed64a8f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:13.662745 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3098e7e5-8be9-40b9-af3a-a0511ed64a8f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:13.664808 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3098e7e5-8be9-40b9-af3a-a0511ed64a8f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:13.665664 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3098e7e5-8be9-40b9-af3a-a0511ed64a8f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:13.666208 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3098e7e5-8be9-40b9-af3a-a0511ed64a8f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:13.666699 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3098e7e5-8be9-40b9-af3a-a0511ed64a8f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:13.707838 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3098e7e5-8be9-40b9-af3a-a0511ed64a8f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:13.708697 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3098e7e5-8be9-40b9-af3a-a0511ed64a8f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:13.709316 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3098e7e5-8be9-40b9-af3a-a0511ed64a8f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:13.710081 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.objects.instance [None req-3098e7e5-8be9-40b9-af3a-a0511ed64a8f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lazy-loading 'fault' on Instance uuid eb8f3b26-f937-4677-b8f9-9208f68a0449 {{(pid=117858) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 07:07:13.716397 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c9fe73b0-2e73-455e-8432-ef2d717b5aaa tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:13.717254 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c9fe73b0-2e73-455e-8432-ef2d717b5aaa tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 51b65dde-1fef-4daa-9475-7609ac03dbc3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:13.724689 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c9fe73b0-2e73-455e-8432-ef2d717b5aaa tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:13.725522 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c9fe73b0-2e73-455e-8432-ef2d717b5aaa tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:13.726145 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c9fe73b0-2e73-455e-8432-ef2d717b5aaa tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:13.727059 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c9fe73b0-2e73-455e-8432-ef2d717b5aaa tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:13.727551 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c9fe73b0-2e73-455e-8432-ef2d717b5aaa tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:13.728021 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c9fe73b0-2e73-455e-8432-ef2d717b5aaa tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:13.757597 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c9fe73b0-2e73-455e-8432-ef2d717b5aaa tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 51b65dde-1fef-4daa-9475-7609ac03dbc3] Going to try to terminate instance {{(pid=117859) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 07:07:13.789876 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-3098e7e5-8be9-40b9-af3a-a0511ed64a8f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:13.801926 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-3098e7e5-8be9-40b9-af3a-a0511ed64a8f tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/eb8f3b26-f937-4677-b8f9-9208f68a0449" status: 200 len: 1332 microversion: 2.1 time: 0.157127 Aug 09 07:07:13.802822 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 320/644] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:07:13 2022] GET /compute/v2.1/servers/eb8f3b26-f937-4677-b8f9-9208f68a0449 => generated 1332 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:07:13.876398 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c9fe73b0-2e73-455e-8432-ef2d717b5aaa tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "DELETE /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3" status: 204 len: 0 microversion: 2.1 time: 0.165127 Aug 09 07:07:13.877772 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 325/645] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 9 07:07:13 2022] DELETE /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 07:07:13.885957 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-4b84be4a-9cce-4872-96f5-7c7db22fb8ec tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:13.887447 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-4b84be4a-9cce-4872-96f5-7c7db22fb8ec tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 51b65dde-1fef-4daa-9475-7609ac03dbc3] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:13.895123 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4b84be4a-9cce-4872-96f5-7c7db22fb8ec tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:13.895877 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4b84be4a-9cce-4872-96f5-7c7db22fb8ec tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:13.896663 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4b84be4a-9cce-4872-96f5-7c7db22fb8ec tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:13.898648 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4b84be4a-9cce-4872-96f5-7c7db22fb8ec tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:13.899457 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4b84be4a-9cce-4872-96f5-7c7db22fb8ec tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:13.900055 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4b84be4a-9cce-4872-96f5-7c7db22fb8ec tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:14.155358 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-4b84be4a-9cce-4872-96f5-7c7db22fb8ec tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:14.164702 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-4b84be4a-9cce-4872-96f5-7c7db22fb8ec tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3" status: 200 len: 1689 microversion: 2.1 time: 0.282464 Aug 09 07:07:14.165654 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 321/646] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:07:13 2022] GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3 => generated 1689 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:07:14.372039 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-f4100328-a376-491f-992f-97124bfa3b6b req-f248e6ff-2079-4165-b969-b2ba4c671682 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7e5215b-7f52-4485-9995-10958c4c3006", "tag": "c73267b0-26d4-4dbf-9245-98ec45d37c2c"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:07:14.382131 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-f4100328-a376-491f-992f-97124bfa3b6b req-f248e6ff-2079-4165-b969-b2ba4c671682 service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:14.382856 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-f4100328-a376-491f-992f-97124bfa3b6b req-f248e6ff-2079-4165-b969-b2ba4c671682 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:14.383448 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-f4100328-a376-491f-992f-97124bfa3b6b req-f248e6ff-2079-4165-b969-b2ba4c671682 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:14.395654 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-f4100328-a376-491f-992f-97124bfa3b6b req-f248e6ff-2079-4165-b969-b2ba4c671682 service nova] Creating event network-changed:c73267b0-26d4-4dbf-9245-98ec45d37c2c for instance e7e5215b-7f52-4485-9995-10958c4c3006 on hv-cinder-85251 Aug 09 07:07:14.401556 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-f4100328-a376-491f-992f-97124bfa3b6b req-f248e6ff-2079-4165-b969-b2ba4c671682 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033759 Aug 09 07:07:14.403381 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 326/647] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:07:14.828728 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-0954fb5c-5837-4a96-b5e1-ba906a9781cc tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:14.829410 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-0954fb5c-5837-4a96-b5e1-ba906a9781cc tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: eb8f3b26-f937-4677-b8f9-9208f68a0449] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:14.835465 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0954fb5c-5837-4a96-b5e1-ba906a9781cc tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:14.835973 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0954fb5c-5837-4a96-b5e1-ba906a9781cc tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:14.836419 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0954fb5c-5837-4a96-b5e1-ba906a9781cc tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:14.837113 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0954fb5c-5837-4a96-b5e1-ba906a9781cc tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:14.837568 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0954fb5c-5837-4a96-b5e1-ba906a9781cc tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:14.837988 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0954fb5c-5837-4a96-b5e1-ba906a9781cc tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:14.853660 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.wsgi [None req-0954fb5c-5837-4a96-b5e1-ba906a9781cc tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] HTTP exception thrown: Instance eb8f3b26-f937-4677-b8f9-9208f68a0449 could not be found. Aug 09 07:07:14.856048 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-0954fb5c-5837-4a96-b5e1-ba906a9781cc tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Request method failure captured: Aug 09 07:07:14.856048 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: request: GET /compute/v2.1/servers/eb8f3b26-f937-4677-b8f9-9208f68a0449 HTTP/1.1 Aug 09 07:07:14.856048 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Accept: application/json Aug 09 07:07:14.856048 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Accept-Encoding: identity Aug 09 07:07:14.856048 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Connection: close Aug 09 07:07:14.856048 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Content-Length: 0 Aug 09 07:07:14.856048 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Content-Type: application/json Aug 09 07:07:14.856048 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Host: 10.222.0.30 Aug 09 07:07:14.856048 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Openstack-System-Scope: None Aug 09 07:07:14.856048 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: User-Agent: python-urllib3/1.26.11 Aug 09 07:07:14.856048 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Auth-Token: gAAAAABi8gaG96fR8jlKQ8TiHSUILZSO2wcQMYr69tPNs3VsPdBbduE5q2N89Qfor1fKdUNuu3cU5AkFy4zL1QPl7jYp6fw9XYg8hg0IW6MscBdP4L-HtUgUgXdSQOw3p3as0Mug0wzwISkStMEUz2JvWC4HKwrWVHwt0TNvR0CveB6NheFq7RI Aug 09 07:07:14.856048 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Domain-Id: None Aug 09 07:07:14.856048 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Domain-Name: None Aug 09 07:07:14.856048 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Identity-Status: Confirmed Aug 09 07:07:14.856048 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Is-Admin-Project: True Aug 09 07:07:14.856048 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Domain-Id: default Aug 09 07:07:14.856048 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Domain-Name: Default Aug 09 07:07:14.856048 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Id: f38c6aa37b9643bbbe5bb7fd3efde4fd Aug 09 07:07:14.856048 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Name: tempest-AttachVolumeNegativeTest-2082484098 Aug 09 07:07:14.856048 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Role: reader,member Aug 09 07:07:14.856048 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Roles: reader,member Aug 09 07:07:14.857384 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f38c6aa37b9643bbbe5bb7fd3efde4fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f38c6aa37b9643bbbe5bb7fd3efde4fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f38c6aa37b9643bbbe5bb7fd3efde4fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f38c6aa37b9643bbbe5bb7fd3efde4fd"}]}] Aug 09 07:07:14.857384 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant: tempest-AttachVolumeNegativeTest-2082484098 Aug 09 07:07:14.857384 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant-Id: f38c6aa37b9643bbbe5bb7fd3efde4fd Aug 09 07:07:14.857384 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2082484098 Aug 09 07:07:14.857384 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User: tempest-AttachVolumeNegativeTest-2082484098-project Aug 09 07:07:14.857384 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Domain-Id: default Aug 09 07:07:14.857384 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Domain-Name: Default Aug 09 07:07:14.857384 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Id: cc885026afe041cca086367bb67d8a9b Aug 09 07:07:14.857384 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Name: tempest-AttachVolumeNegativeTest-2082484098-project Aug 09 07:07:14.857384 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: method: > Aug 09 07:07:14.857384 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: exception: Instance eb8f3b26-f937-4677-b8f9-9208f68a0449 could not be found. Aug 09 07:07:14.857384 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: action_args: {'id': 'eb8f3b26-f937-4677-b8f9-9208f68a0449'} Aug 09 07:07:14.858104 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 07:07:14.858104 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:07:14.858104 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 07:07:14.858104 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 07:07:14.858104 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 07:07:14.858104 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 07:07:14.858104 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 07:07:14.858104 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 07:07:14.858104 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 07:07:14.858104 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 07:07:14.858104 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb8f3b26-f937-4677-b8f9-9208f68a0449 could not be found. Aug 09 07:07:14.858104 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:07:14.858104 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:07:14.858104 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:07:14.858104 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:07:14.858104 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:07:14.858104 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:07:14.858104 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 07:07:14.858104 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 07:07:14.858104 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 07:07:14.859357 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 07:07:14.859357 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 07:07:14.859357 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 07:07:14.859357 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 07:07:14.859357 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 07:07:14.859357 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 07:07:14.859357 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 07:07:14.859357 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb8f3b26-f937-4677-b8f9-9208f68a0449 could not be found. Aug 09 07:07:14.859357 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:07:14.859357 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:07:14.859357 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:07:14.859357 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:07:14.859357 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:07:14.859357 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:07:14.859357 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 07:07:14.859357 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 07:07:14.859357 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb8f3b26-f937-4677-b8f9-9208f68a0449 could not be found. Aug 09 07:07:14.859357 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:07:14.860445 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-0954fb5c-5837-4a96-b5e1-ba906a9781cc tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Returning 404 to user: Instance eb8f3b26-f937-4677-b8f9-9208f68a0449 could not be found. {{(pid=117858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 07:07:14.860445 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-0954fb5c-5837-4a96-b5e1-ba906a9781cc tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/eb8f3b26-f937-4677-b8f9-9208f68a0449" status: 404 len: 111 microversion: 2.1 time: 0.032732 Aug 09 07:07:14.861570 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 322/648] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:07:14 2022] GET /compute/v2.1/servers/eb8f3b26-f937-4677-b8f9-9208f68a0449 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 07:07:14.867401 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-ca19f5df-4ca8-483d-b238-511b3a7d967e tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '.version_select at 0x7f20dd54cca0>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:14.886031 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-ca19f5df-4ca8-483d-b238-511b3a7d967e tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2093328113" status: 202 len: 0 microversion: 2.1 time: 0.022800 Aug 09 07:07:14.887334 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 327/649] 10.222.0.30 () {58 vars in 1221 bytes} [Tue Aug 9 07:07:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2093328113 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 07:07:15.186916 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-a0db79cb-7efb-4f4b-986b-9e1acaa779cf tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:15.187538 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-a0db79cb-7efb-4f4b-986b-9e1acaa779cf tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 51b65dde-1fef-4daa-9475-7609ac03dbc3] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:15.193817 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a0db79cb-7efb-4f4b-986b-9e1acaa779cf tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:15.194304 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a0db79cb-7efb-4f4b-986b-9e1acaa779cf tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:15.194741 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a0db79cb-7efb-4f4b-986b-9e1acaa779cf tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:15.195437 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a0db79cb-7efb-4f4b-986b-9e1acaa779cf tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:15.195917 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a0db79cb-7efb-4f4b-986b-9e1acaa779cf tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:15.196344 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a0db79cb-7efb-4f4b-986b-9e1acaa779cf tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:15.412731 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-a0db79cb-7efb-4f4b-986b-9e1acaa779cf tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:15.421421 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-a0db79cb-7efb-4f4b-986b-9e1acaa779cf tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3" status: 200 len: 1689 microversion: 2.1 time: 0.238812 Aug 09 07:07:15.422192 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 323/650] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:07:15 2022] GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3 => generated 1689 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:07:15.611270 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a526c984-7493-4cab-b18f-ed12b910f41b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Action: 'create', calling method: .version_select at 0x7f20dd33eaf0>, body: {"keypair": {"name": "tempest-keypair-639039505", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIfO2jzf36Nmq8p4Elzw45r2EIkqe6gaJLXeUKynos11r7hcfYeCGMJK3enE/ndf4js0kphJgyNgnX1Pmh8+wq89iGJnyUfsSrS/fj8mMo630Nd0q4W21YcG5z6ZlbOuMA=="}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:07:15.629397 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-a526c984-7493-4cab-b18f-ed12b910f41b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Getting quotas for project f38c6aa37b9643bbbe5bb7fd3efde4fd. Resources: {'key_pairs'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 07:07:15.633246 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-a526c984-7493-4cab-b18f-ed12b910f41b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Getting quotas for user cc885026afe041cca086367bb67d8a9b and project f38c6aa37b9643bbbe5bb7fd3efde4fd. Resources: {'key_pairs'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 07:07:15.654787 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-a526c984-7493-4cab-b18f-ed12b910f41b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047943 Aug 09 07:07:15.655380 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 328/651] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 9 07:07:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 07:07:16.442854 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-7dc1a93a-b89a-490f-b04e-fe98ebbfb49e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:16.443590 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-7dc1a93a-b89a-490f-b04e-fe98ebbfb49e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 51b65dde-1fef-4daa-9475-7609ac03dbc3] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:16.450009 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7dc1a93a-b89a-490f-b04e-fe98ebbfb49e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:16.451140 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7dc1a93a-b89a-490f-b04e-fe98ebbfb49e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:16.451658 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7dc1a93a-b89a-490f-b04e-fe98ebbfb49e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:16.452373 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7dc1a93a-b89a-490f-b04e-fe98ebbfb49e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:16.452856 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7dc1a93a-b89a-490f-b04e-fe98ebbfb49e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:16.453290 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7dc1a93a-b89a-490f-b04e-fe98ebbfb49e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:16.585783 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-7dc1a93a-b89a-490f-b04e-fe98ebbfb49e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:16.593757 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-7dc1a93a-b89a-490f-b04e-fe98ebbfb49e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3" status: 200 len: 1689 microversion: 2.1 time: 0.154732 Aug 09 07:07:16.594414 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 324/652] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:07:16 2022] GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3 => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:07:17.113499 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-65658f53-b0fd-42e6-8f3e-2a16e0fa7cce tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1447597235", "imageRef": "5d2c35cc-2f3b-4a22-bd68-79c71882b6a2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "20e6e819-0a94-455d-a88e-5217530385f8"}], "security_groups": [{"name": "tempest-securitygroup--1245893597"}], "key_name": "tempest-keypair-639039505", "user_data": "}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:07:17.214793 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.network.neutron [None req-65658f53-b0fd-42e6-8f3e-2a16e0fa7cce tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] validate_networks() for [('20e6e819-0a94-455d-a88e-5217530385f8', None, None, None, None, None)] {{(pid=117859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 07:07:17.589007 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-65658f53-b0fd-42e6-8f3e-2a16e0fa7cce tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Flavor limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 07:07:17.589436 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-65658f53-b0fd-42e6-8f3e-2a16e0fa7cce tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Image limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 07:07:17.589914 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-65658f53-b0fd-42e6-8f3e-2a16e0fa7cce tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Flavor pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 07:07:17.590323 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-65658f53-b0fd-42e6-8f3e-2a16e0fa7cce tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Image pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 07:07:17.590734 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-65658f53-b0fd-42e6-8f3e-2a16e0fa7cce tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 07:07:17.600799 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-65658f53-b0fd-42e6-8f3e-2a16e0fa7cce tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:17.601285 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-65658f53-b0fd-42e6-8f3e-2a16e0fa7cce tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:17.601722 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-65658f53-b0fd-42e6-8f3e-2a16e0fa7cce tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:17.602467 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-65658f53-b0fd-42e6-8f3e-2a16e0fa7cce tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:17.602916 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-65658f53-b0fd-42e6-8f3e-2a16e0fa7cce tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:17.603335 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-65658f53-b0fd-42e6-8f3e-2a16e0fa7cce tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:17.615399 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-d7fb1310-b55e-4201-bc37-b23b7004976c tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:17.615945 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:07:17.616971 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-d7fb1310-b55e-4201-bc37-b23b7004976c tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 51b65dde-1fef-4daa-9475-7609ac03dbc3] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:17.623174 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-65658f53-b0fd-42e6-8f3e-2a16e0fa7cce tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Getting quotas for project f38c6aa37b9643bbbe5bb7fd3efde4fd. Resources: {'cores', 'instances', 'ram'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 07:07:17.624498 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d7fb1310-b55e-4201-bc37-b23b7004976c tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:17.625687 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d7fb1310-b55e-4201-bc37-b23b7004976c tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:17.626283 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d7fb1310-b55e-4201-bc37-b23b7004976c tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:17.627643 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d7fb1310-b55e-4201-bc37-b23b7004976c tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:17.628580 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d7fb1310-b55e-4201-bc37-b23b7004976c tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:17.629104 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-65658f53-b0fd-42e6-8f3e-2a16e0fa7cce tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Getting quotas for user cc885026afe041cca086367bb67d8a9b and project f38c6aa37b9643bbbe5bb7fd3efde4fd. Resources: {'cores', 'instances', 'ram'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 07:07:17.629236 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d7fb1310-b55e-4201-bc37-b23b7004976c tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:17.643284 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-65658f53-b0fd-42e6-8f3e-2a16e0fa7cce tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Going to run 1 instances... {{(pid=117859) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 07:07:17.645693 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-65658f53-b0fd-42e6-8f3e-2a16e0fa7cce tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: f4e76bb7-6a13-4dbf-9062-4ba30c528398] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5d2c35cc-2f3b-4a22-bd68-79c71882b6a2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 07:07:17.696342 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-65658f53-b0fd-42e6-8f3e-2a16e0fa7cce tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.587099 Aug 09 07:07:17.703780 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 329/653] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 9 07:07:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 07:07:17.708680 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-87c3775e-498b-4a0c-b4ac-17a3dedd343b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:17.709301 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-87c3775e-498b-4a0c-b4ac-17a3dedd343b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: f4e76bb7-6a13-4dbf-9062-4ba30c528398] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:17.783130 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-87c3775e-498b-4a0c-b4ac-17a3dedd343b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:17.798121 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-87c3775e-498b-4a0c-b4ac-17a3dedd343b tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/f4e76bb7-6a13-4dbf-9062-4ba30c528398" status: 200 len: 1241 microversion: 2.1 time: 0.093157 Aug 09 07:07:17.798792 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 330/654] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:07:17 2022] GET /compute/v2.1/servers/f4e76bb7-6a13-4dbf-9062-4ba30c528398 => generated 1241 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:07:17.812256 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-d7fb1310-b55e-4201-bc37-b23b7004976c tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:17.820219 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-d7fb1310-b55e-4201-bc37-b23b7004976c tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3" status: 200 len: 1689 microversion: 2.1 time: 0.208714 Aug 09 07:07:17.820949 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 325/655] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:07:17 2022] GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3 => generated 1689 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:07:18.378405 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-01cb7323-ed3c-4b6f-b3ea-a7914af45180 req-c1a4c3cc-8327-4781-872f-af017ec1cdc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51b65dde-1fef-4daa-9475-7609ac03dbc3", "name": "network-vif-deleted", "tag": "3d698374-c39d-4ddd-8c8b-02b917b63085"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:07:18.389271 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-01cb7323-ed3c-4b6f-b3ea-a7914af45180 req-c1a4c3cc-8327-4781-872f-af017ec1cdc9 service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:18.389765 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-01cb7323-ed3c-4b6f-b3ea-a7914af45180 req-c1a4c3cc-8327-4781-872f-af017ec1cdc9 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:18.390203 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-01cb7323-ed3c-4b6f-b3ea-a7914af45180 req-c1a4c3cc-8327-4781-872f-af017ec1cdc9 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:18.401622 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-01cb7323-ed3c-4b6f-b3ea-a7914af45180 req-c1a4c3cc-8327-4781-872f-af017ec1cdc9 service nova] Creating event network-vif-deleted:3d698374-c39d-4ddd-8c8b-02b917b63085 for instance 51b65dde-1fef-4daa-9475-7609ac03dbc3 on hv-cinder-85251 Aug 09 07:07:18.407121 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-01cb7323-ed3c-4b6f-b3ea-a7914af45180 req-c1a4c3cc-8327-4781-872f-af017ec1cdc9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032625 Aug 09 07:07:18.407775 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 331/656] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:07:18.819903 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-2f9dcabd-0b1a-4401-8786-c47088ab5a33 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:18.820655 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-2f9dcabd-0b1a-4401-8786-c47088ab5a33 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: f4e76bb7-6a13-4dbf-9062-4ba30c528398] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:18.828462 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2f9dcabd-0b1a-4401-8786-c47088ab5a33 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:18.828968 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2f9dcabd-0b1a-4401-8786-c47088ab5a33 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:18.829480 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2f9dcabd-0b1a-4401-8786-c47088ab5a33 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:18.830401 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2f9dcabd-0b1a-4401-8786-c47088ab5a33 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:18.830957 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2f9dcabd-0b1a-4401-8786-c47088ab5a33 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:18.831386 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2f9dcabd-0b1a-4401-8786-c47088ab5a33 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:18.842468 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-1d45f697-bfae-4270-8354-54cfa568faac tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:18.843154 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-1d45f697-bfae-4270-8354-54cfa568faac tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 51b65dde-1fef-4daa-9475-7609ac03dbc3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:18.849592 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1d45f697-bfae-4270-8354-54cfa568faac tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:18.850074 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1d45f697-bfae-4270-8354-54cfa568faac tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:18.850508 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1d45f697-bfae-4270-8354-54cfa568faac tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:18.851198 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1d45f697-bfae-4270-8354-54cfa568faac tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:18.851725 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1d45f697-bfae-4270-8354-54cfa568faac tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:18.852149 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1d45f697-bfae-4270-8354-54cfa568faac tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:18.868385 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:07:18.888187 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1d45f697-bfae-4270-8354-54cfa568faac tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:18.888669 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1d45f697-bfae-4270-8354-54cfa568faac tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:18.889105 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1d45f697-bfae-4270-8354-54cfa568faac tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:18.889545 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.objects.instance [None req-1d45f697-bfae-4270-8354-54cfa568faac tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lazy-loading 'fault' on Instance uuid 51b65dde-1fef-4daa-9475-7609ac03dbc3 {{(pid=117859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 07:07:18.934703 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-2f9dcabd-0b1a-4401-8786-c47088ab5a33 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:18.942659 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-2f9dcabd-0b1a-4401-8786-c47088ab5a33 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/f4e76bb7-6a13-4dbf-9062-4ba30c528398" status: 200 len: 1311 microversion: 2.1 time: 0.126620 Aug 09 07:07:18.943232 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 326/657] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:07:18 2022] GET /compute/v2.1/servers/f4e76bb7-6a13-4dbf-9062-4ba30c528398 => generated 1311 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:07:18.991819 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-1d45f697-bfae-4270-8354-54cfa568faac tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:19.008686 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-1d45f697-bfae-4270-8354-54cfa568faac tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3" status: 200 len: 1334 microversion: 2.1 time: 0.171111 Aug 09 07:07:19.024353 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 332/658] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:07:18 2022] GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3 => generated 1334 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:07:19.965471 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-ec7ed3a3-7f8f-4a36-a4b7-798e83c4049a tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:19.966131 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-ec7ed3a3-7f8f-4a36-a4b7-798e83c4049a tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: f4e76bb7-6a13-4dbf-9062-4ba30c528398] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:19.972692 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ec7ed3a3-7f8f-4a36-a4b7-798e83c4049a tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:19.973181 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ec7ed3a3-7f8f-4a36-a4b7-798e83c4049a tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:19.973617 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ec7ed3a3-7f8f-4a36-a4b7-798e83c4049a tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:19.974478 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ec7ed3a3-7f8f-4a36-a4b7-798e83c4049a tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:19.974929 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ec7ed3a3-7f8f-4a36-a4b7-798e83c4049a tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:19.975353 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ec7ed3a3-7f8f-4a36-a4b7-798e83c4049a tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:19.979725 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:07:20.035532 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4219ba65-f2fd-4c19-9b79-9eb17b000bdc tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:20.036301 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4219ba65-f2fd-4c19-9b79-9eb17b000bdc tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 51b65dde-1fef-4daa-9475-7609ac03dbc3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:20.042716 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4219ba65-f2fd-4c19-9b79-9eb17b000bdc tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:20.043282 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4219ba65-f2fd-4c19-9b79-9eb17b000bdc tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:20.045067 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4219ba65-f2fd-4c19-9b79-9eb17b000bdc tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:20.045578 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4219ba65-f2fd-4c19-9b79-9eb17b000bdc tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:20.046104 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4219ba65-f2fd-4c19-9b79-9eb17b000bdc tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:20.046638 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4219ba65-f2fd-4c19-9b79-9eb17b000bdc tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:20.061270 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-4219ba65-f2fd-4c19-9b79-9eb17b000bdc tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] HTTP exception thrown: Instance 51b65dde-1fef-4daa-9475-7609ac03dbc3 could not be found. Aug 09 07:07:20.063032 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4219ba65-f2fd-4c19-9b79-9eb17b000bdc tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Request method failure captured: Aug 09 07:07:20.063032 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3 HTTP/1.1 Aug 09 07:07:20.063032 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 09 07:07:20.063032 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 09 07:07:20.063032 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Connection: close Aug 09 07:07:20.063032 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Length: 0 Aug 09 07:07:20.063032 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 09 07:07:20.063032 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.30 Aug 09 07:07:20.063032 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 09 07:07:20.063032 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.11 Aug 09 07:07:20.063032 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi8gaR68LUg4fD8olNfnhK5rGsuZLf2x3TIzuy1CUG3sPjpuV_p2f6hy7YLAChvAXkrqy9P06phVXme741Qxk922cto6wMDgT9kUn7Yz0BZVivdWCpYNCbvZ_IUlx12VWDEDp0qoNPhO2SGvBasUprpkpWeSpi9qySzJJVs0D_hnkcro8 Aug 09 07:07:20.063032 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 09 07:07:20.063032 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 09 07:07:20.063032 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 09 07:07:20.063032 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 09 07:07:20.063032 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 09 07:07:20.063032 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 09 07:07:20.063032 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Id: 517f3dedc5da431b87e398003506c06b Aug 09 07:07:20.063032 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1447651910 Aug 09 07:07:20.063032 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 09 07:07:20.063032 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 09 07:07:20.064610 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/517f3dedc5da431b87e398003506c06b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_517f3dedc5da431b87e398003506c06b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/517f3dedc5da431b87e398003506c06b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/517f3dedc5da431b87e398003506c06b"}]}] Aug 09 07:07:20.064610 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1447651910 Aug 09 07:07:20.064610 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: 517f3dedc5da431b87e398003506c06b Aug 09 07:07:20.064610 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1447651910 Aug 09 07:07:20.064610 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User: tempest-ServerRescueNegativeTestJSON-1447651910-project Aug 09 07:07:20.064610 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 09 07:07:20.064610 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 09 07:07:20.064610 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Id: 19da3c426c6e4c4a889ab5017804c92e Aug 09 07:07:20.064610 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1447651910-project Aug 09 07:07:20.064610 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: method: > Aug 09 07:07:20.064610 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: exception: Instance 51b65dde-1fef-4daa-9475-7609ac03dbc3 could not be found. Aug 09 07:07:20.064610 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: action_args: {'id': '51b65dde-1fef-4daa-9475-7609ac03dbc3'} Aug 09 07:07:20.065464 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 07:07:20.065464 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:07:20.065464 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 07:07:20.065464 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 07:07:20.065464 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 07:07:20.065464 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 07:07:20.065464 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 07:07:20.065464 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 07:07:20.065464 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 07:07:20.065464 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 07:07:20.065464 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51b65dde-1fef-4daa-9475-7609ac03dbc3 could not be found. Aug 09 07:07:20.065464 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:07:20.065464 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:07:20.065464 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:07:20.065464 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:07:20.065464 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:07:20.065464 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:07:20.065464 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 07:07:20.065464 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 07:07:20.065464 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 07:07:20.066850 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 07:07:20.066850 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 07:07:20.066850 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 07:07:20.066850 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 07:07:20.066850 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 07:07:20.066850 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 07:07:20.066850 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 07:07:20.066850 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51b65dde-1fef-4daa-9475-7609ac03dbc3 could not be found. Aug 09 07:07:20.066850 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:07:20.066850 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:07:20.066850 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:07:20.066850 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:07:20.066850 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:07:20.066850 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:07:20.066850 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 07:07:20.066850 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 07:07:20.066850 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51b65dde-1fef-4daa-9475-7609ac03dbc3 could not be found. Aug 09 07:07:20.066850 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:07:20.068114 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4219ba65-f2fd-4c19-9b79-9eb17b000bdc tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Returning 404 to user: Instance 51b65dde-1fef-4daa-9475-7609ac03dbc3 could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 07:07:20.068114 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4219ba65-f2fd-4c19-9b79-9eb17b000bdc tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3" status: 404 len: 111 microversion: 2.1 time: 0.036798 Aug 09 07:07:20.068419 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 333/659] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:07:20 2022] GET /compute/v2.1/servers/51b65dde-1fef-4daa-9475-7609ac03dbc3 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 07:07:20.077022 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-84e01868-e4d2-410f-bdf0-eb282c3d9e5f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '.version_select at 0x7f20dd331ee0>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:20.101518 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-84e01868-e4d2-410f-bdf0-eb282c3d9e5f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-757717107" status: 202 len: 0 microversion: 2.1 time: 0.029222 Aug 09 07:07:20.102236 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 334/660] 10.222.0.30 () {58 vars in 1218 bytes} [Tue Aug 9 07:07:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-757717107 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 07:07:20.403220 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-ec7ed3a3-7f8f-4a36-a4b7-798e83c4049a tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:20.411556 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-ec7ed3a3-7f8f-4a36-a4b7-798e83c4049a tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/f4e76bb7-6a13-4dbf-9062-4ba30c528398" status: 200 len: 1367 microversion: 2.1 time: 0.449881 Aug 09 07:07:20.414611 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 327/661] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:07:19 2022] GET /compute/v2.1/servers/f4e76bb7-6a13-4dbf-9062-4ba30c528398 => generated 1367 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:07:20.431513 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-c3fccac9-08f9-43dc-b2f1-f1ac874eabbe req-a9112258-95f9-4730-bd4e-572fb7f86d0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4e76bb7-6a13-4dbf-9062-4ba30c528398", "tag": "176dfb6a-51a9-4f42-b980-38af9830240a"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:07:20.442441 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-c3fccac9-08f9-43dc-b2f1-f1ac874eabbe req-a9112258-95f9-4730-bd4e-572fb7f86d0f service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:20.443014 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-c3fccac9-08f9-43dc-b2f1-f1ac874eabbe req-a9112258-95f9-4730-bd4e-572fb7f86d0f service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:20.443687 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-c3fccac9-08f9-43dc-b2f1-f1ac874eabbe req-a9112258-95f9-4730-bd4e-572fb7f86d0f service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:20.454559 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-c3fccac9-08f9-43dc-b2f1-f1ac874eabbe req-a9112258-95f9-4730-bd4e-572fb7f86d0f service nova] Creating event network-changed:176dfb6a-51a9-4f42-b980-38af9830240a for instance f4e76bb7-6a13-4dbf-9062-4ba30c528398 on hv-cinder-85251 Aug 09 07:07:20.459754 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-c3fccac9-08f9-43dc-b2f1-f1ac874eabbe req-a9112258-95f9-4730-bd4e-572fb7f86d0f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034620 Aug 09 07:07:20.460353 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 335/662] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:07:21.435487 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-108dd7d8-a98e-4ba6-9040-bc90dd6ad713 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:21.436116 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-108dd7d8-a98e-4ba6-9040-bc90dd6ad713 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: f4e76bb7-6a13-4dbf-9062-4ba30c528398] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:21.442412 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-108dd7d8-a98e-4ba6-9040-bc90dd6ad713 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:21.442889 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-108dd7d8-a98e-4ba6-9040-bc90dd6ad713 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:21.443321 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-108dd7d8-a98e-4ba6-9040-bc90dd6ad713 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:21.444031 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-108dd7d8-a98e-4ba6-9040-bc90dd6ad713 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:21.444481 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-108dd7d8-a98e-4ba6-9040-bc90dd6ad713 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:21.444926 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-108dd7d8-a98e-4ba6-9040-bc90dd6ad713 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:21.577133 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-108dd7d8-a98e-4ba6-9040-bc90dd6ad713 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:21.584823 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-108dd7d8-a98e-4ba6-9040-bc90dd6ad713 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/f4e76bb7-6a13-4dbf-9062-4ba30c528398" status: 200 len: 1367 microversion: 2.1 time: 0.153671 Aug 09 07:07:21.585392 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 328/663] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:07:21 2022] GET /compute/v2.1/servers/f4e76bb7-6a13-4dbf-9062-4ba30c528398 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:07:22.607331 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-1a1cd771-370f-421f-ab70-8b227339bcbc tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:22.608079 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-1a1cd771-370f-421f-ab70-8b227339bcbc tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: f4e76bb7-6a13-4dbf-9062-4ba30c528398] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:22.614144 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1a1cd771-370f-421f-ab70-8b227339bcbc tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:22.614629 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1a1cd771-370f-421f-ab70-8b227339bcbc tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:22.615067 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1a1cd771-370f-421f-ab70-8b227339bcbc tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:22.615795 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1a1cd771-370f-421f-ab70-8b227339bcbc tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:22.616253 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1a1cd771-370f-421f-ab70-8b227339bcbc tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:22.616682 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1a1cd771-370f-421f-ab70-8b227339bcbc tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:22.795628 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-1a1cd771-370f-421f-ab70-8b227339bcbc tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:22.802944 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-1a1cd771-370f-421f-ab70-8b227339bcbc tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/f4e76bb7-6a13-4dbf-9062-4ba30c528398" status: 200 len: 1367 microversion: 2.1 time: 0.200562 Aug 09 07:07:22.803506 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 336/664] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:07:22 2022] GET /compute/v2.1/servers/f4e76bb7-6a13-4dbf-9062-4ba30c528398 => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:07:23.258867 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-d00363eb-c496-4dc3-9d9e-d89abe77140e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:23.259367 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-d00363eb-c496-4dc3-9d9e-d89abe77140e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:23.266784 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d00363eb-c496-4dc3-9d9e-d89abe77140e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:23.267259 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d00363eb-c496-4dc3-9d9e-d89abe77140e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:23.267716 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d00363eb-c496-4dc3-9d9e-d89abe77140e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:23.268403 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d00363eb-c496-4dc3-9d9e-d89abe77140e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:23.268853 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d00363eb-c496-4dc3-9d9e-d89abe77140e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:23.269274 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d00363eb-c496-4dc3-9d9e-d89abe77140e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:23.295018 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-d00363eb-c496-4dc3-9d9e-d89abe77140e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Going to try to terminate instance {{(pid=117858) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 07:07:23.370352 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-d00363eb-c496-4dc3-9d9e-d89abe77140e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "DELETE /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 204 len: 0 microversion: 2.1 time: 0.115056 Aug 09 07:07:23.374507 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 329/665] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 9 07:07:23 2022] DELETE /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 07:07:23.384157 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-9da41e66-8ea7-43da-ba28-ca7291c1c823 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:23.384775 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-9da41e66-8ea7-43da-ba28-ca7291c1c823 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:23.392027 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9da41e66-8ea7-43da-ba28-ca7291c1c823 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:23.392516 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9da41e66-8ea7-43da-ba28-ca7291c1c823 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:23.392954 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9da41e66-8ea7-43da-ba28-ca7291c1c823 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:23.393825 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9da41e66-8ea7-43da-ba28-ca7291c1c823 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:23.394447 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9da41e66-8ea7-43da-ba28-ca7291c1c823 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:23.394875 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9da41e66-8ea7-43da-ba28-ca7291c1c823 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:23.526781 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-9da41e66-8ea7-43da-ba28-ca7291c1c823 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:23.534563 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-9da41e66-8ea7-43da-ba28-ca7291c1c823 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 200 len: 1507 microversion: 2.1 time: 0.158547 Aug 09 07:07:23.535137 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 337/666] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:07:23 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:07:23.824156 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-5e0786cc-9227-4b41-ab6b-a2ff01f53b79 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:23.824773 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-5e0786cc-9227-4b41-ab6b-a2ff01f53b79 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: f4e76bb7-6a13-4dbf-9062-4ba30c528398] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:23.830901 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5e0786cc-9227-4b41-ab6b-a2ff01f53b79 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:23.831380 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5e0786cc-9227-4b41-ab6b-a2ff01f53b79 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:23.831852 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5e0786cc-9227-4b41-ab6b-a2ff01f53b79 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:23.832533 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5e0786cc-9227-4b41-ab6b-a2ff01f53b79 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:23.832985 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5e0786cc-9227-4b41-ab6b-a2ff01f53b79 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:23.833408 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5e0786cc-9227-4b41-ab6b-a2ff01f53b79 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:24.013536 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-5e0786cc-9227-4b41-ab6b-a2ff01f53b79 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:24.020983 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-5e0786cc-9227-4b41-ab6b-a2ff01f53b79 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/f4e76bb7-6a13-4dbf-9062-4ba30c528398" status: 200 len: 1367 microversion: 2.1 time: 0.201186 Aug 09 07:07:24.021555 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 330/667] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:07:23 2022] GET /compute/v2.1/servers/f4e76bb7-6a13-4dbf-9062-4ba30c528398 => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:07:24.556655 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d72404d4-accb-4c05-b936-334cd429877f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:24.557172 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-d72404d4-accb-4c05-b936-334cd429877f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:24.564272 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d72404d4-accb-4c05-b936-334cd429877f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:24.564753 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d72404d4-accb-4c05-b936-334cd429877f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:24.565189 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d72404d4-accb-4c05-b936-334cd429877f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:24.565881 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d72404d4-accb-4c05-b936-334cd429877f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:24.566332 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d72404d4-accb-4c05-b936-334cd429877f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:24.566756 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d72404d4-accb-4c05-b936-334cd429877f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:24.694495 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d72404d4-accb-4c05-b936-334cd429877f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:24.702748 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-d72404d4-accb-4c05-b936-334cd429877f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 200 len: 1507 microversion: 2.1 time: 0.150017 Aug 09 07:07:24.703310 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 338/668] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:07:24 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:07:24.988446 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [req-731fc91f-d4ab-4e3b-ae70-c9a1854d909b req-922ab485-1370-4094-bb0e-64ef01be6a32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4e76bb7-6a13-4dbf-9062-4ba30c528398", "name": "network-vif-plugged", "status": "completed", "tag": "176dfb6a-51a9-4f42-b980-38af9830240a"}]} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:07:25.002003 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-731fc91f-d4ab-4e3b-ae70-c9a1854d909b req-922ab485-1370-4094-bb0e-64ef01be6a32 service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:25.002496 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-731fc91f-d4ab-4e3b-ae70-c9a1854d909b req-922ab485-1370-4094-bb0e-64ef01be6a32 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:25.003192 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-731fc91f-d4ab-4e3b-ae70-c9a1854d909b req-922ab485-1370-4094-bb0e-64ef01be6a32 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:25.014739 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.compute.server_external_events [req-731fc91f-d4ab-4e3b-ae70-c9a1854d909b req-922ab485-1370-4094-bb0e-64ef01be6a32 service nova] Creating event network-vif-plugged:176dfb6a-51a9-4f42-b980-38af9830240a for instance f4e76bb7-6a13-4dbf-9062-4ba30c528398 on hv-cinder-85251 Aug 09 07:07:25.019821 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [req-731fc91f-d4ab-4e3b-ae70-c9a1854d909b req-922ab485-1370-4094-bb0e-64ef01be6a32 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035518 Aug 09 07:07:25.020415 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 331/669] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:07:25.041625 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b2fe4cdb-95ec-441e-987a-82af929c4daa tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:25.042244 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b2fe4cdb-95ec-441e-987a-82af929c4daa tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: f4e76bb7-6a13-4dbf-9062-4ba30c528398] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:25.049126 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b2fe4cdb-95ec-441e-987a-82af929c4daa tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:25.049615 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b2fe4cdb-95ec-441e-987a-82af929c4daa tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:25.050059 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b2fe4cdb-95ec-441e-987a-82af929c4daa tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:25.050752 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b2fe4cdb-95ec-441e-987a-82af929c4daa tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:25.051209 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b2fe4cdb-95ec-441e-987a-82af929c4daa tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:25.051651 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b2fe4cdb-95ec-441e-987a-82af929c4daa tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:25.184017 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b2fe4cdb-95ec-441e-987a-82af929c4daa tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:25.192098 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b2fe4cdb-95ec-441e-987a-82af929c4daa tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/f4e76bb7-6a13-4dbf-9062-4ba30c528398" status: 200 len: 1367 microversion: 2.1 time: 0.154529 Aug 09 07:07:25.192665 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 339/670] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:07:25 2022] GET /compute/v2.1/servers/f4e76bb7-6a13-4dbf-9062-4ba30c528398 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:07:25.724232 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-56573aae-81aa-4949-ae1e-8a6762bbe8d1 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:25.724912 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-56573aae-81aa-4949-ae1e-8a6762bbe8d1 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:25.726864 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:07:25.733213 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-56573aae-81aa-4949-ae1e-8a6762bbe8d1 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:25.733763 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-56573aae-81aa-4949-ae1e-8a6762bbe8d1 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:25.734193 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-56573aae-81aa-4949-ae1e-8a6762bbe8d1 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:25.734920 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-56573aae-81aa-4949-ae1e-8a6762bbe8d1 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:25.735369 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-56573aae-81aa-4949-ae1e-8a6762bbe8d1 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:25.735819 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-56573aae-81aa-4949-ae1e-8a6762bbe8d1 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:25.871645 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-56573aae-81aa-4949-ae1e-8a6762bbe8d1 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:25.880049 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-56573aae-81aa-4949-ae1e-8a6762bbe8d1 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 200 len: 1507 microversion: 2.1 time: 0.160052 Aug 09 07:07:25.880671 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 332/671] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:07:25 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:07:26.212694 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-97a04100-5e06-46de-8822-becc98fa87bb tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:26.213308 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-97a04100-5e06-46de-8822-becc98fa87bb tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: f4e76bb7-6a13-4dbf-9062-4ba30c528398] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:26.219881 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-97a04100-5e06-46de-8822-becc98fa87bb tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:26.220427 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-97a04100-5e06-46de-8822-becc98fa87bb tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:26.220864 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-97a04100-5e06-46de-8822-becc98fa87bb tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:26.221600 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-97a04100-5e06-46de-8822-becc98fa87bb tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:26.222072 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-97a04100-5e06-46de-8822-becc98fa87bb tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:26.222487 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-97a04100-5e06-46de-8822-becc98fa87bb tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:26.355282 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-97a04100-5e06-46de-8822-becc98fa87bb tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:26.362871 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-97a04100-5e06-46de-8822-becc98fa87bb tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/f4e76bb7-6a13-4dbf-9062-4ba30c528398" status: 200 len: 1367 microversion: 2.1 time: 0.154102 Aug 09 07:07:26.363443 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 340/672] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:07:26 2022] GET /compute/v2.1/servers/f4e76bb7-6a13-4dbf-9062-4ba30c528398 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:07:26.885145 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [req-dab77c83-fd88-4779-9524-cd7b1aeba37b req-a45ac8e1-2149-483e-bc15-49e2598bd800 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64c9caf8-5201-418c-ba08-9bc9f5a55f57", "name": "network-vif-deleted", "tag": "4d513942-ac8d-433b-899e-8512feefa9a7"}]} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:07:26.897798 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-dab77c83-fd88-4779-9524-cd7b1aeba37b req-a45ac8e1-2149-483e-bc15-49e2598bd800 service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:26.898315 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-dab77c83-fd88-4779-9524-cd7b1aeba37b req-a45ac8e1-2149-483e-bc15-49e2598bd800 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:26.901151 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a4bbe4f7-44d6-428e-b8a8-af2b8b84c29e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:26.901714 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-a4bbe4f7-44d6-428e-b8a8-af2b8b84c29e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:26.907872 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-dab77c83-fd88-4779-9524-cd7b1aeba37b req-a45ac8e1-2149-483e-bc15-49e2598bd800 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:26.908822 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a4bbe4f7-44d6-428e-b8a8-af2b8b84c29e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:26.909347 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a4bbe4f7-44d6-428e-b8a8-af2b8b84c29e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:26.909739 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a4bbe4f7-44d6-428e-b8a8-af2b8b84c29e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:26.910449 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a4bbe4f7-44d6-428e-b8a8-af2b8b84c29e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:26.910958 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a4bbe4f7-44d6-428e-b8a8-af2b8b84c29e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:26.911437 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a4bbe4f7-44d6-428e-b8a8-af2b8b84c29e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:26.924954 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.compute.server_external_events [req-dab77c83-fd88-4779-9524-cd7b1aeba37b req-a45ac8e1-2149-483e-bc15-49e2598bd800 service nova] Creating event network-vif-deleted:4d513942-ac8d-433b-899e-8512feefa9a7 for instance 64c9caf8-5201-418c-ba08-9bc9f5a55f57 on hv-cinder-85251 Aug 09 07:07:26.929713 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [req-dab77c83-fd88-4779-9524-cd7b1aeba37b req-a45ac8e1-2149-483e-bc15-49e2598bd800 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048714 Aug 09 07:07:26.930630 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 333/673] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:07:26.989233 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-a4bbe4f7-44d6-428e-b8a8-af2b8b84c29e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:26.997062 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-a4bbe4f7-44d6-428e-b8a8-af2b8b84c29e tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 200 len: 1292 microversion: 2.1 time: 0.099813 Aug 09 07:07:26.997634 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 341/674] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:07:26 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 1292 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:07:27.384379 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-e2fe75d1-c054-44d6-aaf6-e7c7eb6e2894 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:27.385069 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-e2fe75d1-c054-44d6-aaf6-e7c7eb6e2894 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: f4e76bb7-6a13-4dbf-9062-4ba30c528398] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:27.391673 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e2fe75d1-c054-44d6-aaf6-e7c7eb6e2894 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:27.392161 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e2fe75d1-c054-44d6-aaf6-e7c7eb6e2894 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:27.392594 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e2fe75d1-c054-44d6-aaf6-e7c7eb6e2894 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:27.393277 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e2fe75d1-c054-44d6-aaf6-e7c7eb6e2894 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:27.393728 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e2fe75d1-c054-44d6-aaf6-e7c7eb6e2894 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:27.394153 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e2fe75d1-c054-44d6-aaf6-e7c7eb6e2894 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:27.524045 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-e2fe75d1-c054-44d6-aaf6-e7c7eb6e2894 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:27.532415 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-e2fe75d1-c054-44d6-aaf6-e7c7eb6e2894 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/f4e76bb7-6a13-4dbf-9062-4ba30c528398" status: 200 len: 1367 microversion: 2.1 time: 0.152190 Aug 09 07:07:27.532992 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 334/675] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:07:27 2022] GET /compute/v2.1/servers/f4e76bb7-6a13-4dbf-9062-4ba30c528398 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:07:28.018426 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-92bf6104-b7ad-45e5-bdea-17dee4e1e7eb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:28.019037 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-92bf6104-b7ad-45e5-bdea-17dee4e1e7eb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 64c9caf8-5201-418c-ba08-9bc9f5a55f57] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:28.021532 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=2 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:07:28.022251 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=12 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:07:28.028538 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-92bf6104-b7ad-45e5-bdea-17dee4e1e7eb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:28.029028 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-92bf6104-b7ad-45e5-bdea-17dee4e1e7eb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:28.029460 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-92bf6104-b7ad-45e5-bdea-17dee4e1e7eb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:28.030168 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-92bf6104-b7ad-45e5-bdea-17dee4e1e7eb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:28.030668 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-92bf6104-b7ad-45e5-bdea-17dee4e1e7eb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:28.031088 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-92bf6104-b7ad-45e5-bdea-17dee4e1e7eb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:28.045846 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-92bf6104-b7ad-45e5-bdea-17dee4e1e7eb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] HTTP exception thrown: Instance 64c9caf8-5201-418c-ba08-9bc9f5a55f57 could not be found. Aug 09 07:07:28.047466 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-92bf6104-b7ad-45e5-bdea-17dee4e1e7eb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Request method failure captured: Aug 09 07:07:28.047466 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 HTTP/1.1 Aug 09 07:07:28.047466 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 09 07:07:28.047466 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 09 07:07:28.047466 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Connection: close Aug 09 07:07:28.047466 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Length: 0 Aug 09 07:07:28.047466 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 09 07:07:28.047466 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.30 Aug 09 07:07:28.047466 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 09 07:07:28.047466 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.11 Aug 09 07:07:28.047466 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi8gaR68LUg4fD8olNfnhK5rGsuZLf2x3TIzuy1CUG3sPjpuV_p2f6hy7YLAChvAXkrqy9P06phVXme741Qxk922cto6wMDgT9kUn7Yz0BZVivdWCpYNCbvZ_IUlx12VWDEDp0qoNPhO2SGvBasUprpkpWeSpi9qySzJJVs0D_hnkcro8 Aug 09 07:07:28.047466 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 09 07:07:28.047466 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 09 07:07:28.047466 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 09 07:07:28.047466 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 09 07:07:28.047466 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 09 07:07:28.047466 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 09 07:07:28.047466 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Id: 517f3dedc5da431b87e398003506c06b Aug 09 07:07:28.047466 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1447651910 Aug 09 07:07:28.047466 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 09 07:07:28.047466 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 09 07:07:28.049016 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/517f3dedc5da431b87e398003506c06b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_517f3dedc5da431b87e398003506c06b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/517f3dedc5da431b87e398003506c06b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/517f3dedc5da431b87e398003506c06b"}]}] Aug 09 07:07:28.049016 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1447651910 Aug 09 07:07:28.049016 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: 517f3dedc5da431b87e398003506c06b Aug 09 07:07:28.049016 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1447651910 Aug 09 07:07:28.049016 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User: tempest-ServerRescueNegativeTestJSON-1447651910-project Aug 09 07:07:28.049016 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 09 07:07:28.049016 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 09 07:07:28.049016 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Id: 19da3c426c6e4c4a889ab5017804c92e Aug 09 07:07:28.049016 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1447651910-project Aug 09 07:07:28.049016 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: method: > Aug 09 07:07:28.049016 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: exception: Instance 64c9caf8-5201-418c-ba08-9bc9f5a55f57 could not be found. Aug 09 07:07:28.049016 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: action_args: {'id': '64c9caf8-5201-418c-ba08-9bc9f5a55f57'} Aug 09 07:07:28.049848 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 07:07:28.049848 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:07:28.049848 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 07:07:28.049848 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 07:07:28.049848 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 07:07:28.049848 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 07:07:28.049848 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 07:07:28.049848 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 07:07:28.049848 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 07:07:28.049848 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 07:07:28.049848 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64c9caf8-5201-418c-ba08-9bc9f5a55f57 could not be found. Aug 09 07:07:28.049848 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:07:28.049848 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:07:28.049848 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:07:28.049848 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:07:28.049848 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:07:28.049848 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:07:28.049848 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 07:07:28.049848 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 07:07:28.049848 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 07:07:28.051218 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 07:07:28.051218 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 07:07:28.051218 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 07:07:28.051218 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 07:07:28.051218 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 07:07:28.051218 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 07:07:28.051218 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 07:07:28.051218 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64c9caf8-5201-418c-ba08-9bc9f5a55f57 could not be found. Aug 09 07:07:28.051218 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:07:28.051218 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:07:28.051218 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:07:28.051218 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:07:28.051218 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:07:28.051218 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:07:28.051218 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 07:07:28.051218 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 07:07:28.051218 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64c9caf8-5201-418c-ba08-9bc9f5a55f57 could not be found. Aug 09 07:07:28.051218 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:07:28.052548 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-92bf6104-b7ad-45e5-bdea-17dee4e1e7eb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Returning 404 to user: Instance 64c9caf8-5201-418c-ba08-9bc9f5a55f57 could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 07:07:28.052548 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-92bf6104-b7ad-45e5-bdea-17dee4e1e7eb tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57" status: 404 len: 111 microversion: 2.1 time: 0.034370 Aug 09 07:07:28.052548 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 342/676] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:07:28 2022] GET /compute/v2.1/servers/64c9caf8-5201-418c-ba08-9bc9f5a55f57 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 07:07:28.057502 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-abfd9e33-a1e0-4dcd-8fc1-cafbdfef1e71 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:28.057996 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-abfd9e33-a1e0-4dcd-8fc1-cafbdfef1e71 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 9fe62967-63ba-4d67-88c4-25e1c1d445fa] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:28.065215 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-abfd9e33-a1e0-4dcd-8fc1-cafbdfef1e71 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:28.065694 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-abfd9e33-a1e0-4dcd-8fc1-cafbdfef1e71 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:28.066133 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-abfd9e33-a1e0-4dcd-8fc1-cafbdfef1e71 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:28.066820 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-abfd9e33-a1e0-4dcd-8fc1-cafbdfef1e71 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:28.067274 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-abfd9e33-a1e0-4dcd-8fc1-cafbdfef1e71 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:28.067725 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-abfd9e33-a1e0-4dcd-8fc1-cafbdfef1e71 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:28.092905 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-abfd9e33-a1e0-4dcd-8fc1-cafbdfef1e71 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 9fe62967-63ba-4d67-88c4-25e1c1d445fa] Going to try to terminate instance {{(pid=117858) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 07:07:28.167925 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-abfd9e33-a1e0-4dcd-8fc1-cafbdfef1e71 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "DELETE /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa" status: 204 len: 0 microversion: 2.1 time: 0.114039 Aug 09 07:07:28.168507 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 335/677] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 9 07:07:28 2022] DELETE /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 07:07:28.177488 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e0deab4a-419e-4a89-a107-dd3e6811669f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:28.178095 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-e0deab4a-419e-4a89-a107-dd3e6811669f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 9fe62967-63ba-4d67-88c4-25e1c1d445fa] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:28.184015 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e0deab4a-419e-4a89-a107-dd3e6811669f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:28.184494 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e0deab4a-419e-4a89-a107-dd3e6811669f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:28.184928 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e0deab4a-419e-4a89-a107-dd3e6811669f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:28.186231 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e0deab4a-419e-4a89-a107-dd3e6811669f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:28.187082 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e0deab4a-419e-4a89-a107-dd3e6811669f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:28.187264 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e0deab4a-419e-4a89-a107-dd3e6811669f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:28.318863 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e0deab4a-419e-4a89-a107-dd3e6811669f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:28.326328 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-e0deab4a-419e-4a89-a107-dd3e6811669f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa" status: 200 len: 1523 microversion: 2.1 time: 0.152650 Aug 09 07:07:28.326917 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 343/678] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:07:28 2022] GET /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:07:28.553610 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-6cf791cc-3cd7-4fe8-9f00-73344b8e57d5 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:28.554569 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-6cf791cc-3cd7-4fe8-9f00-73344b8e57d5 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: f4e76bb7-6a13-4dbf-9062-4ba30c528398] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:28.560498 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6cf791cc-3cd7-4fe8-9f00-73344b8e57d5 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:28.560984 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6cf791cc-3cd7-4fe8-9f00-73344b8e57d5 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:28.561417 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6cf791cc-3cd7-4fe8-9f00-73344b8e57d5 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:28.562112 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6cf791cc-3cd7-4fe8-9f00-73344b8e57d5 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:28.562573 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6cf791cc-3cd7-4fe8-9f00-73344b8e57d5 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:28.563000 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6cf791cc-3cd7-4fe8-9f00-73344b8e57d5 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:28.698163 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-6cf791cc-3cd7-4fe8-9f00-73344b8e57d5 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:28.706317 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-6cf791cc-3cd7-4fe8-9f00-73344b8e57d5 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/f4e76bb7-6a13-4dbf-9062-4ba30c528398" status: 200 len: 1558 microversion: 2.1 time: 0.156901 Aug 09 07:07:28.706890 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 336/679] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:07:28 2022] GET /compute/v2.1/servers/f4e76bb7-6a13-4dbf-9062-4ba30c528398 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:07:28.727316 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4b635ac3-6dc4-4f43-9fc4-838a71825a30 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:28.727916 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4b635ac3-6dc4-4f43-9fc4-838a71825a30 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: f4e76bb7-6a13-4dbf-9062-4ba30c528398] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:28.733823 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4b635ac3-6dc4-4f43-9fc4-838a71825a30 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:28.734369 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4b635ac3-6dc4-4f43-9fc4-838a71825a30 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:28.734870 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4b635ac3-6dc4-4f43-9fc4-838a71825a30 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:28.735693 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4b635ac3-6dc4-4f43-9fc4-838a71825a30 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:28.736213 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4b635ac3-6dc4-4f43-9fc4-838a71825a30 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:28.736706 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4b635ac3-6dc4-4f43-9fc4-838a71825a30 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:28.812995 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4b635ac3-6dc4-4f43-9fc4-838a71825a30 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/f4e76bb7-6a13-4dbf-9062-4ba30c528398/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089471 Aug 09 07:07:28.813661 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 344/680] 10.222.0.30 () {58 vars in 1275 bytes} [Tue Aug 9 07:07:28 2022] GET /compute/v2.1/servers/f4e76bb7-6a13-4dbf-9062-4ba30c528398/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:07:29.347273 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-d2911efe-d4cf-442f-b3ad-fe9379277dc7 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:29.347852 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-d2911efe-d4cf-442f-b3ad-fe9379277dc7 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 9fe62967-63ba-4d67-88c4-25e1c1d445fa] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:29.354233 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d2911efe-d4cf-442f-b3ad-fe9379277dc7 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:29.354717 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d2911efe-d4cf-442f-b3ad-fe9379277dc7 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:29.355155 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d2911efe-d4cf-442f-b3ad-fe9379277dc7 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:29.355872 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d2911efe-d4cf-442f-b3ad-fe9379277dc7 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:29.356335 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d2911efe-d4cf-442f-b3ad-fe9379277dc7 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:29.356784 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d2911efe-d4cf-442f-b3ad-fe9379277dc7 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:29.590040 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-d2911efe-d4cf-442f-b3ad-fe9379277dc7 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:29.597807 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-d2911efe-d4cf-442f-b3ad-fe9379277dc7 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa" status: 200 len: 1523 microversion: 2.1 time: 0.254404 Aug 09 07:07:29.598342 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 337/681] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:07:29 2022] GET /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa => generated 1523 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:07:29.808276 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-da0c7285-ac71-4ac9-85cb-162205304b8e req-d484802d-46a1-48e5-b24e-3ea6cae42901 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4e76bb7-6a13-4dbf-9062-4ba30c528398", "tag": "176dfb6a-51a9-4f42-b980-38af9830240a"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:07:29.819157 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-da0c7285-ac71-4ac9-85cb-162205304b8e req-d484802d-46a1-48e5-b24e-3ea6cae42901 service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:29.819648 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-da0c7285-ac71-4ac9-85cb-162205304b8e req-d484802d-46a1-48e5-b24e-3ea6cae42901 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:29.820075 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-da0c7285-ac71-4ac9-85cb-162205304b8e req-d484802d-46a1-48e5-b24e-3ea6cae42901 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:29.831408 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-da0c7285-ac71-4ac9-85cb-162205304b8e req-d484802d-46a1-48e5-b24e-3ea6cae42901 service nova] Creating event network-changed:176dfb6a-51a9-4f42-b980-38af9830240a for instance f4e76bb7-6a13-4dbf-9062-4ba30c528398 on hv-cinder-85251 Aug 09 07:07:29.836482 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-da0c7285-ac71-4ac9-85cb-162205304b8e req-d484802d-46a1-48e5-b24e-3ea6cae42901 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032324 Aug 09 07:07:29.837249 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 345/682] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:07:30.618323 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-4a7a54c6-af9e-4db9-b90a-2b5036efa699 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:30.619108 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-4a7a54c6-af9e-4db9-b90a-2b5036efa699 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 9fe62967-63ba-4d67-88c4-25e1c1d445fa] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:30.628391 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4a7a54c6-af9e-4db9-b90a-2b5036efa699 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:30.628939 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4a7a54c6-af9e-4db9-b90a-2b5036efa699 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:30.629508 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4a7a54c6-af9e-4db9-b90a-2b5036efa699 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:30.630330 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4a7a54c6-af9e-4db9-b90a-2b5036efa699 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:30.630871 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4a7a54c6-af9e-4db9-b90a-2b5036efa699 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:30.631353 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4a7a54c6-af9e-4db9-b90a-2b5036efa699 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:30.756100 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f8c24bf8-99ea-4f3f-8a7f-ed40fb18a701 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:30.756835 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-f8c24bf8-99ea-4f3f-8a7f-ed40fb18a701 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:30.766729 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-4a7a54c6-af9e-4db9-b90a-2b5036efa699 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:30.767228 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f8c24bf8-99ea-4f3f-8a7f-ed40fb18a701 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:30.768150 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f8c24bf8-99ea-4f3f-8a7f-ed40fb18a701 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:30.769066 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f8c24bf8-99ea-4f3f-8a7f-ed40fb18a701 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:30.772425 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f8c24bf8-99ea-4f3f-8a7f-ed40fb18a701 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:30.772894 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f8c24bf8-99ea-4f3f-8a7f-ed40fb18a701 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:30.773330 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f8c24bf8-99ea-4f3f-8a7f-ed40fb18a701 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:30.780301 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-4a7a54c6-af9e-4db9-b90a-2b5036efa699 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa" status: 200 len: 1523 microversion: 2.1 time: 0.165757 Aug 09 07:07:30.781543 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 338/683] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:07:30 2022] GET /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:07:30.797489 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f8c24bf8-99ea-4f3f-8a7f-ed40fb18a701 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8/ips" status: 200 len: 151 microversion: 2.20 time: 0.046512 Aug 09 07:07:30.798071 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 346/684] 10.222.0.30 () {60 vars in 1289 bytes} [Tue Aug 9 07:07:30 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8/ips => generated 151 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 07:07:31.801565 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-4d3e8983-10e9-47c6-a8bf-1a8eb498eb9f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:31.802169 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-4d3e8983-10e9-47c6-a8bf-1a8eb498eb9f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 9fe62967-63ba-4d67-88c4-25e1c1d445fa] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:31.808663 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4d3e8983-10e9-47c6-a8bf-1a8eb498eb9f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:31.809173 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4d3e8983-10e9-47c6-a8bf-1a8eb498eb9f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:31.809612 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4d3e8983-10e9-47c6-a8bf-1a8eb498eb9f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:31.811021 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4d3e8983-10e9-47c6-a8bf-1a8eb498eb9f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:31.811668 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4d3e8983-10e9-47c6-a8bf-1a8eb498eb9f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:31.812188 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4d3e8983-10e9-47c6-a8bf-1a8eb498eb9f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:31.946328 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-4d3e8983-10e9-47c6-a8bf-1a8eb498eb9f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19da3c426c6e4c4a889ab5017804c92e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '517f3dedc5da431b87e398003506c06b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:31.953954 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-4d3e8983-10e9-47c6-a8bf-1a8eb498eb9f tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa" status: 200 len: 1523 microversion: 2.1 time: 0.156217 Aug 09 07:07:31.954610 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 339/685] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:07:31 2022] GET /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:07:32.200846 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-f8b8b85a-4ca0-4639-b757-04164654666b req-699dc64d-0111-40f8-b3cb-f88d6be119e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fe62967-63ba-4d67-88c4-25e1c1d445fa", "name": "network-vif-deleted", "tag": "c3f302ed-7425-4dd7-9fc2-33ba9fdf4954"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:07:32.213647 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-f8b8b85a-4ca0-4639-b757-04164654666b req-699dc64d-0111-40f8-b3cb-f88d6be119e3 service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:32.214124 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-f8b8b85a-4ca0-4639-b757-04164654666b req-699dc64d-0111-40f8-b3cb-f88d6be119e3 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:32.214548 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-f8b8b85a-4ca0-4639-b757-04164654666b req-699dc64d-0111-40f8-b3cb-f88d6be119e3 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:32.228940 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-f8b8b85a-4ca0-4639-b757-04164654666b req-699dc64d-0111-40f8-b3cb-f88d6be119e3 service nova] Creating event network-vif-deleted:c3f302ed-7425-4dd7-9fc2-33ba9fdf4954 for instance 9fe62967-63ba-4d67-88c4-25e1c1d445fa on hv-cinder-85251 Aug 09 07:07:32.236574 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-f8b8b85a-4ca0-4639-b757-04164654666b req-699dc64d-0111-40f8-b3cb-f88d6be119e3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039210 Aug 09 07:07:32.237224 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 347/686] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:07:32.826662 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-e5411664-b8d1-491d-9581-d457b300e3ec tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:07:32.827182 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-e5411664-b8d1-491d-9581-d457b300e3ec tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:32.833383 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e5411664-b8d1-491d-9581-d457b300e3ec tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:32.833894 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e5411664-b8d1-491d-9581-d457b300e3ec tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:32.834326 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e5411664-b8d1-491d-9581-d457b300e3ec tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:32.835009 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e5411664-b8d1-491d-9581-d457b300e3ec tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:32.835489 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e5411664-b8d1-491d-9581-d457b300e3ec tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:32.835946 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e5411664-b8d1-491d-9581-d457b300e3ec tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:32.859809 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.objects.instance [None req-e5411664-b8d1-491d-9581-d457b300e3ec tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lazy-loading 'flavor' on Instance uuid cf38e7a7-b39a-4966-aa2d-effc83a555b8 {{(pid=117858) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 07:07:32.895686 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:07:32.974581 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f787cda8-047a-45ab-96e6-d15f5096e448 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:32.975352 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-f787cda8-047a-45ab-96e6-d15f5096e448 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] [instance: 9fe62967-63ba-4d67-88c4-25e1c1d445fa] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:32.981507 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f787cda8-047a-45ab-96e6-d15f5096e448 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:32.982746 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f787cda8-047a-45ab-96e6-d15f5096e448 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:32.983380 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f787cda8-047a-45ab-96e6-d15f5096e448 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:32.984121 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f787cda8-047a-45ab-96e6-d15f5096e448 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:32.984574 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f787cda8-047a-45ab-96e6-d15f5096e448 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:32.984995 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f787cda8-047a-45ab-96e6-d15f5096e448 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:32.998126 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-f787cda8-047a-45ab-96e6-d15f5096e448 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] HTTP exception thrown: Instance 9fe62967-63ba-4d67-88c4-25e1c1d445fa could not be found. Aug 09 07:07:32.999798 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f787cda8-047a-45ab-96e6-d15f5096e448 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Request method failure captured: Aug 09 07:07:32.999798 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa HTTP/1.1 Aug 09 07:07:32.999798 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 09 07:07:32.999798 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 09 07:07:32.999798 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Connection: close Aug 09 07:07:32.999798 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Length: 0 Aug 09 07:07:32.999798 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 09 07:07:32.999798 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.30 Aug 09 07:07:32.999798 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 09 07:07:32.999798 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.11 Aug 09 07:07:32.999798 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi8gaR68LUg4fD8olNfnhK5rGsuZLf2x3TIzuy1CUG3sPjpuV_p2f6hy7YLAChvAXkrqy9P06phVXme741Qxk922cto6wMDgT9kUn7Yz0BZVivdWCpYNCbvZ_IUlx12VWDEDp0qoNPhO2SGvBasUprpkpWeSpi9qySzJJVs0D_hnkcro8 Aug 09 07:07:32.999798 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 09 07:07:32.999798 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 09 07:07:32.999798 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 09 07:07:32.999798 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 09 07:07:32.999798 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 09 07:07:32.999798 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 09 07:07:32.999798 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Id: 517f3dedc5da431b87e398003506c06b Aug 09 07:07:32.999798 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1447651910 Aug 09 07:07:32.999798 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 09 07:07:32.999798 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 09 07:07:33.001422 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/517f3dedc5da431b87e398003506c06b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_517f3dedc5da431b87e398003506c06b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/517f3dedc5da431b87e398003506c06b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/517f3dedc5da431b87e398003506c06b"}]}] Aug 09 07:07:33.001422 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1447651910 Aug 09 07:07:33.001422 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: 517f3dedc5da431b87e398003506c06b Aug 09 07:07:33.001422 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1447651910 Aug 09 07:07:33.001422 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User: tempest-ServerRescueNegativeTestJSON-1447651910-project Aug 09 07:07:33.001422 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 09 07:07:33.001422 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 09 07:07:33.001422 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Id: 19da3c426c6e4c4a889ab5017804c92e Aug 09 07:07:33.001422 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1447651910-project Aug 09 07:07:33.001422 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: method: > Aug 09 07:07:33.001422 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: exception: Instance 9fe62967-63ba-4d67-88c4-25e1c1d445fa could not be found. Aug 09 07:07:33.001422 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: action_args: {'id': '9fe62967-63ba-4d67-88c4-25e1c1d445fa'} Aug 09 07:07:33.002201 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 07:07:33.002201 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:07:33.002201 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 07:07:33.002201 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 07:07:33.002201 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 07:07:33.002201 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 07:07:33.002201 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 07:07:33.002201 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 07:07:33.002201 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 07:07:33.002201 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 07:07:33.002201 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fe62967-63ba-4d67-88c4-25e1c1d445fa could not be found. Aug 09 07:07:33.002201 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:07:33.002201 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:07:33.002201 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:07:33.002201 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:07:33.002201 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:07:33.002201 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:07:33.002201 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 07:07:33.002201 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 07:07:33.002201 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 07:07:33.003850 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 07:07:33.003850 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 07:07:33.003850 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 07:07:33.003850 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 07:07:33.003850 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 07:07:33.003850 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 07:07:33.003850 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 07:07:33.003850 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fe62967-63ba-4d67-88c4-25e1c1d445fa could not be found. Aug 09 07:07:33.003850 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:07:33.003850 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:07:33.003850 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:07:33.003850 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:07:33.003850 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:07:33.003850 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:07:33.003850 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 07:07:33.003850 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 07:07:33.003850 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fe62967-63ba-4d67-88c4-25e1c1d445fa could not be found. Aug 09 07:07:33.003850 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:07:33.005029 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f787cda8-047a-45ab-96e6-d15f5096e448 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] Returning 404 to user: Instance 9fe62967-63ba-4d67-88c4-25e1c1d445fa could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 07:07:33.005029 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f787cda8-047a-45ab-96e6-d15f5096e448 tempest-ServerRescueNegativeTestJSON-1447651910 tempest-ServerRescueNegativeTestJSON-1447651910-project] 10.222.0.30 "GET /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa" status: 404 len: 111 microversion: 2.1 time: 0.030769 Aug 09 07:07:33.005029 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 348/687] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:07:32 2022] GET /compute/v2.1/servers/9fe62967-63ba-4d67-88c4-25e1c1d445fa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 07:07:33.049996 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-e5411664-b8d1-491d-9581-d457b300e3ec tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "POST /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8/action" status: 202 len: 0 microversion: 2.20 time: 0.226942 Aug 09 07:07:33.050628 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 340/688] 10.222.0.30 () {62 vars in 1319 bytes} [Tue Aug 9 07:07:32 2022] POST /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 07:07:33.062127 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-9efe1f22-54d1-4001-b111-9d2432fcf50e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:33.063239 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-9efe1f22-54d1-4001-b111-9d2432fcf50e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:33.072385 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9efe1f22-54d1-4001-b111-9d2432fcf50e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:33.073170 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9efe1f22-54d1-4001-b111-9d2432fcf50e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:33.073933 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9efe1f22-54d1-4001-b111-9d2432fcf50e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:33.075088 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9efe1f22-54d1-4001-b111-9d2432fcf50e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:33.075974 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9efe1f22-54d1-4001-b111-9d2432fcf50e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:33.076745 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9efe1f22-54d1-4001-b111-9d2432fcf50e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:33.210856 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-9efe1f22-54d1-4001-b111-9d2432fcf50e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:33.219909 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-9efe1f22-54d1-4001-b111-9d2432fcf50e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:33.221457 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-9efe1f22-54d1-4001-b111-9d2432fcf50e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:33.222632 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-9efe1f22-54d1-4001-b111-9d2432fcf50e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 200 len: 1723 microversion: 2.20 time: 0.167203 Aug 09 07:07:33.223191 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 349/689] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:07:33 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:07:34.245760 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-e7fc59f1-c046-444a-b98f-cc9258c43e8b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:34.246455 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-e7fc59f1-c046-444a-b98f-cc9258c43e8b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:34.254587 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e7fc59f1-c046-444a-b98f-cc9258c43e8b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:34.255068 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e7fc59f1-c046-444a-b98f-cc9258c43e8b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:34.255499 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e7fc59f1-c046-444a-b98f-cc9258c43e8b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:34.256221 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e7fc59f1-c046-444a-b98f-cc9258c43e8b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:34.256674 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e7fc59f1-c046-444a-b98f-cc9258c43e8b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:34.257096 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e7fc59f1-c046-444a-b98f-cc9258c43e8b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:34.386537 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-e7fc59f1-c046-444a-b98f-cc9258c43e8b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:34.395565 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-e7fc59f1-c046-444a-b98f-cc9258c43e8b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:34.397092 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-e7fc59f1-c046-444a-b98f-cc9258c43e8b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:34.398235 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-e7fc59f1-c046-444a-b98f-cc9258c43e8b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 200 len: 1723 microversion: 2.20 time: 0.156793 Aug 09 07:07:34.398786 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 341/690] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:07:34 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:07:35.420531 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b57fb0c9-93f2-4c08-b439-92465d6e214e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:35.421227 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b57fb0c9-93f2-4c08-b439-92465d6e214e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:35.427575 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b57fb0c9-93f2-4c08-b439-92465d6e214e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:35.428085 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b57fb0c9-93f2-4c08-b439-92465d6e214e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:35.428520 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b57fb0c9-93f2-4c08-b439-92465d6e214e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:35.429221 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b57fb0c9-93f2-4c08-b439-92465d6e214e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:35.429672 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b57fb0c9-93f2-4c08-b439-92465d6e214e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:35.430095 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b57fb0c9-93f2-4c08-b439-92465d6e214e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:35.570144 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b57fb0c9-93f2-4c08-b439-92465d6e214e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:35.578483 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b57fb0c9-93f2-4c08-b439-92465d6e214e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:35.580039 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b57fb0c9-93f2-4c08-b439-92465d6e214e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:35.581212 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b57fb0c9-93f2-4c08-b439-92465d6e214e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 200 len: 1723 microversion: 2.20 time: 0.165139 Aug 09 07:07:35.582276 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 350/691] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:07:35 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:07:36.604304 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-c3892881-0110-4d74-aae9-9a4278d6cd2d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:36.604909 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-c3892881-0110-4d74-aae9-9a4278d6cd2d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:36.611367 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c3892881-0110-4d74-aae9-9a4278d6cd2d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:36.611887 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c3892881-0110-4d74-aae9-9a4278d6cd2d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:36.612382 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c3892881-0110-4d74-aae9-9a4278d6cd2d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:36.613086 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c3892881-0110-4d74-aae9-9a4278d6cd2d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:36.613541 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c3892881-0110-4d74-aae9-9a4278d6cd2d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:36.613970 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c3892881-0110-4d74-aae9-9a4278d6cd2d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:36.773702 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-c3892881-0110-4d74-aae9-9a4278d6cd2d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:36.782691 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-c3892881-0110-4d74-aae9-9a4278d6cd2d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:36.784384 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-c3892881-0110-4d74-aae9-9a4278d6cd2d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:36.785632 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-c3892881-0110-4d74-aae9-9a4278d6cd2d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 200 len: 1723 microversion: 2.20 time: 0.185338 Aug 09 07:07:36.786279 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 342/692] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:07:36 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:07:37.809275 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-0a710e76-6788-45be-8c62-5f8e93b11c4e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:37.811029 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-0a710e76-6788-45be-8c62-5f8e93b11c4e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:37.817645 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0a710e76-6788-45be-8c62-5f8e93b11c4e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:37.818131 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0a710e76-6788-45be-8c62-5f8e93b11c4e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:37.818568 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0a710e76-6788-45be-8c62-5f8e93b11c4e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:37.819269 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0a710e76-6788-45be-8c62-5f8e93b11c4e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:37.819756 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0a710e76-6788-45be-8c62-5f8e93b11c4e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:37.820184 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0a710e76-6788-45be-8c62-5f8e93b11c4e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:37.955658 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-0a710e76-6788-45be-8c62-5f8e93b11c4e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:37.964337 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-0a710e76-6788-45be-8c62-5f8e93b11c4e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:37.965942 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-0a710e76-6788-45be-8c62-5f8e93b11c4e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:37.968043 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-0a710e76-6788-45be-8c62-5f8e93b11c4e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 200 len: 1723 microversion: 2.20 time: 0.162662 Aug 09 07:07:37.968684 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 351/693] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:07:37 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:07:38.992513 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-7d97da55-2a3d-431a-8072-acde6a56bcae tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:38.993167 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-7d97da55-2a3d-431a-8072-acde6a56bcae tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:39.000573 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7d97da55-2a3d-431a-8072-acde6a56bcae tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:39.001017 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7d97da55-2a3d-431a-8072-acde6a56bcae tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:39.001470 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7d97da55-2a3d-431a-8072-acde6a56bcae tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:39.002167 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7d97da55-2a3d-431a-8072-acde6a56bcae tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:39.002624 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7d97da55-2a3d-431a-8072-acde6a56bcae tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:39.003305 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7d97da55-2a3d-431a-8072-acde6a56bcae tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:39.146497 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-7d97da55-2a3d-431a-8072-acde6a56bcae tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:39.154607 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-7d97da55-2a3d-431a-8072-acde6a56bcae tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:39.156231 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-7d97da55-2a3d-431a-8072-acde6a56bcae tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:39.157458 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-7d97da55-2a3d-431a-8072-acde6a56bcae tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 200 len: 1723 microversion: 2.20 time: 0.168962 Aug 09 07:07:39.158097 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 343/694] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:07:38 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:07:39.944196 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 07:07:39.944372 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Tue Aug 9 07:07:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 07:07:40.180800 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-8983f40e-17ba-4bec-8b07-ac7baafb99f2 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:40.181402 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-8983f40e-17ba-4bec-8b07-ac7baafb99f2 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:40.189002 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8983f40e-17ba-4bec-8b07-ac7baafb99f2 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:40.189481 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8983f40e-17ba-4bec-8b07-ac7baafb99f2 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:40.189909 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8983f40e-17ba-4bec-8b07-ac7baafb99f2 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:40.190700 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8983f40e-17ba-4bec-8b07-ac7baafb99f2 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:40.191150 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8983f40e-17ba-4bec-8b07-ac7baafb99f2 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:40.191571 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8983f40e-17ba-4bec-8b07-ac7baafb99f2 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:40.329465 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8983f40e-17ba-4bec-8b07-ac7baafb99f2 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:40.337615 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8983f40e-17ba-4bec-8b07-ac7baafb99f2 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:40.339196 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8983f40e-17ba-4bec-8b07-ac7baafb99f2 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:40.340496 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-8983f40e-17ba-4bec-8b07-ac7baafb99f2 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 200 len: 1723 microversion: 2.20 time: 0.163624 Aug 09 07:07:40.341099 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 352/695] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:07:40 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:07:41.363919 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-861d8500-9605-4ee0-b479-14592a2601b1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:41.365324 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-861d8500-9605-4ee0-b479-14592a2601b1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:41.371841 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-861d8500-9605-4ee0-b479-14592a2601b1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:41.372381 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-861d8500-9605-4ee0-b479-14592a2601b1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:41.372791 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-861d8500-9605-4ee0-b479-14592a2601b1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:41.373497 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-861d8500-9605-4ee0-b479-14592a2601b1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:41.374025 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-861d8500-9605-4ee0-b479-14592a2601b1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:41.374457 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-861d8500-9605-4ee0-b479-14592a2601b1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:41.509987 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-861d8500-9605-4ee0-b479-14592a2601b1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:41.518740 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-861d8500-9605-4ee0-b479-14592a2601b1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:41.520371 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-861d8500-9605-4ee0-b479-14592a2601b1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:41.521618 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-861d8500-9605-4ee0-b479-14592a2601b1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 200 len: 1723 microversion: 2.20 time: 0.161828 Aug 09 07:07:41.522251 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 344/696] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:07:41 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:07:42.724640 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-8a9ef119-0a14-48c8-a66e-bde3540a8c46 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:42.725251 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-8a9ef119-0a14-48c8-a66e-bde3540a8c46 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:42.731293 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8a9ef119-0a14-48c8-a66e-bde3540a8c46 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:42.731955 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8a9ef119-0a14-48c8-a66e-bde3540a8c46 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:42.732392 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8a9ef119-0a14-48c8-a66e-bde3540a8c46 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:42.733094 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8a9ef119-0a14-48c8-a66e-bde3540a8c46 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:42.733552 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8a9ef119-0a14-48c8-a66e-bde3540a8c46 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:42.733985 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8a9ef119-0a14-48c8-a66e-bde3540a8c46 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:42.877415 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8a9ef119-0a14-48c8-a66e-bde3540a8c46 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:42.885673 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8a9ef119-0a14-48c8-a66e-bde3540a8c46 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:42.887156 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8a9ef119-0a14-48c8-a66e-bde3540a8c46 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:42.889060 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-8a9ef119-0a14-48c8-a66e-bde3540a8c46 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 200 len: 1723 microversion: 2.20 time: 0.347646 Aug 09 07:07:42.889610 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 353/697] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:07:42 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 1723 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:07:43.912478 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-6aeaa251-8ad6-4a54-8558-056f9a6085aa tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:43.913079 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-6aeaa251-8ad6-4a54-8558-056f9a6085aa tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:43.924486 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6aeaa251-8ad6-4a54-8558-056f9a6085aa tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:43.925038 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6aeaa251-8ad6-4a54-8558-056f9a6085aa tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:43.925476 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6aeaa251-8ad6-4a54-8558-056f9a6085aa tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:43.926175 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6aeaa251-8ad6-4a54-8558-056f9a6085aa tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:43.926630 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6aeaa251-8ad6-4a54-8558-056f9a6085aa tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:43.930139 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6aeaa251-8ad6-4a54-8558-056f9a6085aa tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:44.071228 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-6aeaa251-8ad6-4a54-8558-056f9a6085aa tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:44.079204 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-6aeaa251-8ad6-4a54-8558-056f9a6085aa tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:44.080739 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-6aeaa251-8ad6-4a54-8558-056f9a6085aa tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:44.081885 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-6aeaa251-8ad6-4a54-8558-056f9a6085aa tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 200 len: 1723 microversion: 2.20 time: 0.173421 Aug 09 07:07:44.082426 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 345/698] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:07:43 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:07:45.104639 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-8783df5a-607d-47c5-994e-dff1b8e25e45 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:45.105236 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-8783df5a-607d-47c5-994e-dff1b8e25e45 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:45.112337 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8783df5a-607d-47c5-994e-dff1b8e25e45 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:45.112856 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8783df5a-607d-47c5-994e-dff1b8e25e45 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:45.113292 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8783df5a-607d-47c5-994e-dff1b8e25e45 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:45.113987 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8783df5a-607d-47c5-994e-dff1b8e25e45 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:45.114438 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8783df5a-607d-47c5-994e-dff1b8e25e45 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:45.114861 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8783df5a-607d-47c5-994e-dff1b8e25e45 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:45.119035 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=100 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:07:45.246571 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8783df5a-607d-47c5-994e-dff1b8e25e45 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:45.255645 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8783df5a-607d-47c5-994e-dff1b8e25e45 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:45.257273 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8783df5a-607d-47c5-994e-dff1b8e25e45 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:45.258699 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-8783df5a-607d-47c5-994e-dff1b8e25e45 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 200 len: 1723 microversion: 2.20 time: 0.158089 Aug 09 07:07:45.259337 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 354/699] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:07:45 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:07:46.282082 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-29988807-3408-4f82-ba13-bd6ccb785cdb tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:46.282686 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-29988807-3408-4f82-ba13-bd6ccb785cdb tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:46.289082 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-29988807-3408-4f82-ba13-bd6ccb785cdb tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:46.289557 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-29988807-3408-4f82-ba13-bd6ccb785cdb tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:46.289986 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-29988807-3408-4f82-ba13-bd6ccb785cdb tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:46.290666 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-29988807-3408-4f82-ba13-bd6ccb785cdb tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:46.291111 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-29988807-3408-4f82-ba13-bd6ccb785cdb tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:46.291531 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-29988807-3408-4f82-ba13-bd6ccb785cdb tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:46.682881 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-29988807-3408-4f82-ba13-bd6ccb785cdb tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:46.691150 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-29988807-3408-4f82-ba13-bd6ccb785cdb tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:46.692915 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-29988807-3408-4f82-ba13-bd6ccb785cdb tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:46.694196 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-29988807-3408-4f82-ba13-bd6ccb785cdb tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 200 len: 1723 microversion: 2.20 time: 0.416031 Aug 09 07:07:46.694809 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 346/700] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:07:46 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 1723 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:07:47.718005 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e60ff233-6dd1-4a0f-9cef-30b9100fa9dc tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:47.718665 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-e60ff233-6dd1-4a0f-9cef-30b9100fa9dc tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:47.720893 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:07:47.726056 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e60ff233-6dd1-4a0f-9cef-30b9100fa9dc tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:47.726533 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e60ff233-6dd1-4a0f-9cef-30b9100fa9dc tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:47.726961 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e60ff233-6dd1-4a0f-9cef-30b9100fa9dc tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:47.727666 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e60ff233-6dd1-4a0f-9cef-30b9100fa9dc tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:47.728119 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e60ff233-6dd1-4a0f-9cef-30b9100fa9dc tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:47.728541 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e60ff233-6dd1-4a0f-9cef-30b9100fa9dc tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:47.867745 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e60ff233-6dd1-4a0f-9cef-30b9100fa9dc tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:47.875897 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e60ff233-6dd1-4a0f-9cef-30b9100fa9dc tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:47.877507 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e60ff233-6dd1-4a0f-9cef-30b9100fa9dc tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:47.879003 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-e60ff233-6dd1-4a0f-9cef-30b9100fa9dc tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 200 len: 1723 microversion: 2.20 time: 0.164977 Aug 09 07:07:47.879490 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 355/701] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:07:47 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:07:48.902267 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-ae36c0a4-2ae3-421a-8b15-925690d95794 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:48.902880 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-ae36c0a4-2ae3-421a-8b15-925690d95794 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:48.909382 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ae36c0a4-2ae3-421a-8b15-925690d95794 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:48.909857 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ae36c0a4-2ae3-421a-8b15-925690d95794 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:48.910292 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ae36c0a4-2ae3-421a-8b15-925690d95794 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:48.910976 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ae36c0a4-2ae3-421a-8b15-925690d95794 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:48.911462 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ae36c0a4-2ae3-421a-8b15-925690d95794 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:48.911919 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ae36c0a4-2ae3-421a-8b15-925690d95794 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:49.046720 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-ae36c0a4-2ae3-421a-8b15-925690d95794 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:49.054741 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-ae36c0a4-2ae3-421a-8b15-925690d95794 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:49.056421 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-ae36c0a4-2ae3-421a-8b15-925690d95794 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:49.057704 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-ae36c0a4-2ae3-421a-8b15-925690d95794 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 200 len: 1744 microversion: 2.20 time: 0.159307 Aug 09 07:07:49.058269 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 347/702] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:07:48 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:07:50.081177 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-edcc2655-2836-4148-b0ca-897a312538aa tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:50.081782 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-edcc2655-2836-4148-b0ca-897a312538aa tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:50.088133 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-edcc2655-2836-4148-b0ca-897a312538aa tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:50.088612 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-edcc2655-2836-4148-b0ca-897a312538aa tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:50.089044 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-edcc2655-2836-4148-b0ca-897a312538aa tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:50.089731 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-edcc2655-2836-4148-b0ca-897a312538aa tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:50.090180 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-edcc2655-2836-4148-b0ca-897a312538aa tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:50.090604 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-edcc2655-2836-4148-b0ca-897a312538aa tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:50.219289 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-edcc2655-2836-4148-b0ca-897a312538aa tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:50.227262 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-edcc2655-2836-4148-b0ca-897a312538aa tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:50.228795 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-edcc2655-2836-4148-b0ca-897a312538aa tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:50.229940 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-edcc2655-2836-4148-b0ca-897a312538aa tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 200 len: 1744 microversion: 2.20 time: 0.152761 Aug 09 07:07:50.230489 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 356/703] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:07:50 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:07:51.129724 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-de24fe1c-5fa4-43ce-b7e2-3226304fd699 req-01116884-8e34-41fb-a5ae-ae62fe4e0846 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf38e7a7-b39a-4966-aa2d-effc83a555b8", "name": "network-vif-plugged", "status": "completed", "tag": "067648c9-4dd9-4848-a425-3cbbac00eedd"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:07:51.140642 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-de24fe1c-5fa4-43ce-b7e2-3226304fd699 req-01116884-8e34-41fb-a5ae-ae62fe4e0846 service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:51.141167 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-de24fe1c-5fa4-43ce-b7e2-3226304fd699 req-01116884-8e34-41fb-a5ae-ae62fe4e0846 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:51.141583 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-de24fe1c-5fa4-43ce-b7e2-3226304fd699 req-01116884-8e34-41fb-a5ae-ae62fe4e0846 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:51.155506 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-de24fe1c-5fa4-43ce-b7e2-3226304fd699 req-01116884-8e34-41fb-a5ae-ae62fe4e0846 service nova] Creating event network-vif-plugged:067648c9-4dd9-4848-a425-3cbbac00eedd for instance cf38e7a7-b39a-4966-aa2d-effc83a555b8 on hv-cinder-85251 Aug 09 07:07:51.161123 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-de24fe1c-5fa4-43ce-b7e2-3226304fd699 req-01116884-8e34-41fb-a5ae-ae62fe4e0846 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035845 Aug 09 07:07:51.162403 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 357/704] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 07:07:51.254330 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-37ff85f9-0ada-4de5-bca3-0c2859a18fc2 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:51.255285 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-37ff85f9-0ada-4de5-bca3-0c2859a18fc2 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:51.261485 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-37ff85f9-0ada-4de5-bca3-0c2859a18fc2 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:51.262260 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-37ff85f9-0ada-4de5-bca3-0c2859a18fc2 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:51.263512 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-37ff85f9-0ada-4de5-bca3-0c2859a18fc2 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:51.264335 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-37ff85f9-0ada-4de5-bca3-0c2859a18fc2 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:51.264867 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-37ff85f9-0ada-4de5-bca3-0c2859a18fc2 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:51.265513 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-37ff85f9-0ada-4de5-bca3-0c2859a18fc2 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:51.302018 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-1c6ba420-b193-4ed3-88d1-03e20adaeede tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:51.303133 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-1c6ba420-b193-4ed3-88d1-03e20adaeede tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: e7e5215b-7f52-4485-9995-10958c4c3006] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:51.309970 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1c6ba420-b193-4ed3-88d1-03e20adaeede tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:51.310971 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1c6ba420-b193-4ed3-88d1-03e20adaeede tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:51.311654 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1c6ba420-b193-4ed3-88d1-03e20adaeede tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:51.312662 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1c6ba420-b193-4ed3-88d1-03e20adaeede tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:51.313129 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1c6ba420-b193-4ed3-88d1-03e20adaeede tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:51.313556 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1c6ba420-b193-4ed3-88d1-03e20adaeede tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:51.339498 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-1c6ba420-b193-4ed3-88d1-03e20adaeede tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006/ips" status: 200 len: 146 microversion: 2.1 time: 0.245542 Aug 09 07:07:51.347722 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 348/705] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Aug 9 07:07:51 2022] GET /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006/ips => generated 146 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:07:51.406674 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-37ff85f9-0ada-4de5-bca3-0c2859a18fc2 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:51.414816 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-37ff85f9-0ada-4de5-bca3-0c2859a18fc2 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:51.416336 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-37ff85f9-0ada-4de5-bca3-0c2859a18fc2 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:51.417962 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-37ff85f9-0ada-4de5-bca3-0c2859a18fc2 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 200 len: 1739 microversion: 2.20 time: 0.168703 Aug 09 07:07:51.418681 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 358/706] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:07:51 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 1739 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 07:07:52.441728 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-5d39f5a3-1a05-4fd0-8950-730828a41525 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:52.442602 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-5d39f5a3-1a05-4fd0-8950-730828a41525 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:52.449305 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5d39f5a3-1a05-4fd0-8950-730828a41525 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:52.450655 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5d39f5a3-1a05-4fd0-8950-730828a41525 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:52.451452 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5d39f5a3-1a05-4fd0-8950-730828a41525 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:52.452377 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5d39f5a3-1a05-4fd0-8950-730828a41525 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:52.453031 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5d39f5a3-1a05-4fd0-8950-730828a41525 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:52.453650 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5d39f5a3-1a05-4fd0-8950-730828a41525 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:52.609984 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-5d39f5a3-1a05-4fd0-8950-730828a41525 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:52.620824 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-5d39f5a3-1a05-4fd0-8950-730828a41525 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:52.622466 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-5d39f5a3-1a05-4fd0-8950-730828a41525 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:52.623694 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-5d39f5a3-1a05-4fd0-8950-730828a41525 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 200 len: 1739 microversion: 2.20 time: 0.185986 Aug 09 07:07:52.642809 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 349/707] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:07:52 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 1739 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:07:52.771838 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-7e04d5d7-3f45-4cc8-96e1-ddd1f5b2b076 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4c2f3d81-045f-4c12-b35b-1ff5e83c32a6"}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:07:52.775177 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-7e04d5d7-3f45-4cc8-96e1-ddd1f5b2b076 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: e7e5215b-7f52-4485-9995-10958c4c3006] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:52.782269 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7e04d5d7-3f45-4cc8-96e1-ddd1f5b2b076 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:52.783000 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7e04d5d7-3f45-4cc8-96e1-ddd1f5b2b076 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:52.783689 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7e04d5d7-3f45-4cc8-96e1-ddd1f5b2b076 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:52.784820 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7e04d5d7-3f45-4cc8-96e1-ddd1f5b2b076 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:52.785362 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7e04d5d7-3f45-4cc8-96e1-ddd1f5b2b076 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:52.785861 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7e04d5d7-3f45-4cc8-96e1-ddd1f5b2b076 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:53.096868 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-7e04d5d7-3f45-4cc8-96e1-ddd1f5b2b076 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "POST /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.328649 Aug 09 07:07:53.098169 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 359/708] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Aug 9 07:07:52 2022] POST /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006/os-volume_attachments => generated 194 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:07:53.650597 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-3d6a7a47-a0d5-45a6-b03a-2afb53713a21 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:53.652029 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-3d6a7a47-a0d5-45a6-b03a-2afb53713a21 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:53.658815 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3d6a7a47-a0d5-45a6-b03a-2afb53713a21 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:53.659537 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3d6a7a47-a0d5-45a6-b03a-2afb53713a21 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:53.660162 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3d6a7a47-a0d5-45a6-b03a-2afb53713a21 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:53.661040 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3d6a7a47-a0d5-45a6-b03a-2afb53713a21 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:53.661503 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3d6a7a47-a0d5-45a6-b03a-2afb53713a21 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:53.661954 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3d6a7a47-a0d5-45a6-b03a-2afb53713a21 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:53.837562 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-3d6a7a47-a0d5-45a6-b03a-2afb53713a21 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:53.852456 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-3d6a7a47-a0d5-45a6-b03a-2afb53713a21 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:53.854279 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-3d6a7a47-a0d5-45a6-b03a-2afb53713a21 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:53.855702 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-3d6a7a47-a0d5-45a6-b03a-2afb53713a21 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 200 len: 1739 microversion: 2.20 time: 0.209153 Aug 09 07:07:53.857017 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 350/709] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:07:53 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 1739 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:07:54.881799 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-655ba6b5-7b7c-4028-9ff7-49847e18f800 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:54.883616 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-655ba6b5-7b7c-4028-9ff7-49847e18f800 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:54.893341 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-655ba6b5-7b7c-4028-9ff7-49847e18f800 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:54.894070 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-655ba6b5-7b7c-4028-9ff7-49847e18f800 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:54.894674 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-655ba6b5-7b7c-4028-9ff7-49847e18f800 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:54.895381 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-655ba6b5-7b7c-4028-9ff7-49847e18f800 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:54.896024 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-655ba6b5-7b7c-4028-9ff7-49847e18f800 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:54.896453 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-655ba6b5-7b7c-4028-9ff7-49847e18f800 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:55.072711 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-655ba6b5-7b7c-4028-9ff7-49847e18f800 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:55.083037 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-655ba6b5-7b7c-4028-9ff7-49847e18f800 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:55.084915 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-655ba6b5-7b7c-4028-9ff7-49847e18f800 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:55.086189 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-655ba6b5-7b7c-4028-9ff7-49847e18f800 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 200 len: 1739 microversion: 2.20 time: 0.211115 Aug 09 07:07:55.086839 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 360/710] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:07:54 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 1739 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:07:56.115705 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-2a260bdd-22e9-4489-89d6-5ed6e06c55bd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:56.118706 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-2a260bdd-22e9-4489-89d6-5ed6e06c55bd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:56.137485 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:07:56.141101 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2a260bdd-22e9-4489-89d6-5ed6e06c55bd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:56.141561 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2a260bdd-22e9-4489-89d6-5ed6e06c55bd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:56.144584 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2a260bdd-22e9-4489-89d6-5ed6e06c55bd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:56.145530 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2a260bdd-22e9-4489-89d6-5ed6e06c55bd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:56.146139 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2a260bdd-22e9-4489-89d6-5ed6e06c55bd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:56.148105 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2a260bdd-22e9-4489-89d6-5ed6e06c55bd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:56.358032 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-2a260bdd-22e9-4489-89d6-5ed6e06c55bd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:56.366774 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-2a260bdd-22e9-4489-89d6-5ed6e06c55bd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:56.368298 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-2a260bdd-22e9-4489-89d6-5ed6e06c55bd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:56.370492 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-2a260bdd-22e9-4489-89d6-5ed6e06c55bd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 200 len: 1739 microversion: 2.20 time: 0.261228 Aug 09 07:07:56.371752 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 351/711] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:07:56 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 1739 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:07:57.394758 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f39dafb8-a39f-47a4-a6de-15d9dd19a404 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:57.399376 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-f39dafb8-a39f-47a4-a6de-15d9dd19a404 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:57.417908 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f39dafb8-a39f-47a4-a6de-15d9dd19a404 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:57.420364 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f39dafb8-a39f-47a4-a6de-15d9dd19a404 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:57.420967 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f39dafb8-a39f-47a4-a6de-15d9dd19a404 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:57.422876 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f39dafb8-a39f-47a4-a6de-15d9dd19a404 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:57.424420 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f39dafb8-a39f-47a4-a6de-15d9dd19a404 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:57.426357 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f39dafb8-a39f-47a4-a6de-15d9dd19a404 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:57.630396 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-f39dafb8-a39f-47a4-a6de-15d9dd19a404 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:57.639270 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-f39dafb8-a39f-47a4-a6de-15d9dd19a404 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:57.640808 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-f39dafb8-a39f-47a4-a6de-15d9dd19a404 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:57.641980 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f39dafb8-a39f-47a4-a6de-15d9dd19a404 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 200 len: 1739 microversion: 2.20 time: 0.251214 Aug 09 07:07:57.643377 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 361/712] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:07:57 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 1739 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:07:58.673868 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-9dae17b1-2984-4e2f-ad88-ed7178d9f56d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:58.675107 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-9dae17b1-2984-4e2f-ad88-ed7178d9f56d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:58.681674 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9dae17b1-2984-4e2f-ad88-ed7178d9f56d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:58.682156 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9dae17b1-2984-4e2f-ad88-ed7178d9f56d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:58.682803 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9dae17b1-2984-4e2f-ad88-ed7178d9f56d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:58.683495 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9dae17b1-2984-4e2f-ad88-ed7178d9f56d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:58.683969 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9dae17b1-2984-4e2f-ad88-ed7178d9f56d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:58.685243 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9dae17b1-2984-4e2f-ad88-ed7178d9f56d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:58.837196 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-9dae17b1-2984-4e2f-ad88-ed7178d9f56d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:58.848669 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-9dae17b1-2984-4e2f-ad88-ed7178d9f56d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:58.850738 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-9dae17b1-2984-4e2f-ad88-ed7178d9f56d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:07:58.852208 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-9dae17b1-2984-4e2f-ad88-ed7178d9f56d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 200 len: 1739 microversion: 2.20 time: 0.185928 Aug 09 07:07:58.853163 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 352/713] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:07:58 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 1739 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:07:59.875577 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c6665685-8ef2-431e-b07b-4480930fc1fc tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:07:59.876821 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c6665685-8ef2-431e-b07b-4480930fc1fc tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:07:59.888313 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c6665685-8ef2-431e-b07b-4480930fc1fc tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:59.889701 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c6665685-8ef2-431e-b07b-4480930fc1fc tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:59.890292 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c6665685-8ef2-431e-b07b-4480930fc1fc tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:07:59.891273 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c6665685-8ef2-431e-b07b-4480930fc1fc tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:07:59.891827 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c6665685-8ef2-431e-b07b-4480930fc1fc tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:07:59.892510 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c6665685-8ef2-431e-b07b-4480930fc1fc tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:00.040805 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c6665685-8ef2-431e-b07b-4480930fc1fc tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:00.050977 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c6665685-8ef2-431e-b07b-4480930fc1fc tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:00.052498 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c6665685-8ef2-431e-b07b-4480930fc1fc tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:00.053660 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c6665685-8ef2-431e-b07b-4480930fc1fc tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 200 len: 1739 microversion: 2.20 time: 0.182858 Aug 09 07:08:00.055709 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 362/714] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:07:59 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 1739 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:08:00.771056 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-ffa12264-cec5-45f6-83c3-d9dbc78165da tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:00.773342 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-ffa12264-cec5-45f6-83c3-d9dbc78165da tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: e7e5215b-7f52-4485-9995-10958c4c3006] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:00.780527 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ffa12264-cec5-45f6-83c3-d9dbc78165da tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:00.781349 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ffa12264-cec5-45f6-83c3-d9dbc78165da tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:00.781893 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ffa12264-cec5-45f6-83c3-d9dbc78165da tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:00.782692 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ffa12264-cec5-45f6-83c3-d9dbc78165da tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:00.783233 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ffa12264-cec5-45f6-83c3-d9dbc78165da tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:00.783915 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ffa12264-cec5-45f6-83c3-d9dbc78165da tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:00.815537 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-ffa12264-cec5-45f6-83c3-d9dbc78165da tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048402 Aug 09 07:08:00.821622 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 353/715] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 9 07:08:00 2022] GET /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:08:00.827419 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e5dd568a-6604-46a2-a183-891ef5d5ad0c tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:00.827984 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-e5dd568a-6604-46a2-a183-891ef5d5ad0c tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: e7e5215b-7f52-4485-9995-10958c4c3006] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:00.834160 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e5dd568a-6604-46a2-a183-891ef5d5ad0c tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:00.834642 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e5dd568a-6604-46a2-a183-891ef5d5ad0c tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:00.835072 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e5dd568a-6604-46a2-a183-891ef5d5ad0c tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:00.835905 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e5dd568a-6604-46a2-a183-891ef5d5ad0c tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:00.836365 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e5dd568a-6604-46a2-a183-891ef5d5ad0c tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:00.836790 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e5dd568a-6604-46a2-a183-891ef5d5ad0c tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:00.869236 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-e5dd568a-6604-46a2-a183-891ef5d5ad0c tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006/os-volume_attachments/4c2f3d81-045f-4c12-b35b-1ff5e83c32a6" status: 200 len: 194 microversion: 2.1 time: 0.046388 Aug 09 07:08:00.869842 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 363/716] 10.222.0.30 () {58 vars in 1413 bytes} [Tue Aug 9 07:08:00 2022] GET /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006/os-volume_attachments/4c2f3d81-045f-4c12-b35b-1ff5e83c32a6 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 07:08:01.090170 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-b9ea5408-33a6-4803-ab42-43740bfc046e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:01.091334 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-b9ea5408-33a6-4803-ab42-43740bfc046e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:01.103146 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b9ea5408-33a6-4803-ab42-43740bfc046e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:01.103971 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b9ea5408-33a6-4803-ab42-43740bfc046e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:01.104551 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b9ea5408-33a6-4803-ab42-43740bfc046e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:01.105733 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b9ea5408-33a6-4803-ab42-43740bfc046e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:01.106560 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b9ea5408-33a6-4803-ab42-43740bfc046e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:01.107135 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b9ea5408-33a6-4803-ab42-43740bfc046e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:01.327839 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-b9ea5408-33a6-4803-ab42-43740bfc046e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:01.336456 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-b9ea5408-33a6-4803-ab42-43740bfc046e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:01.338008 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-b9ea5408-33a6-4803-ab42-43740bfc046e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:01.339384 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-b9ea5408-33a6-4803-ab42-43740bfc046e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 200 len: 1721 microversion: 2.20 time: 0.263721 Aug 09 07:08:01.344800 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 354/717] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:08:01 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 1721 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:08:02.236584 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-fc8199bc-d7d8-4914-8161-d8735a7b2023 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c3025662-90bb-416c-bd16-c14175231a04"}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:08:02.239211 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-fc8199bc-d7d8-4914-8161-d8735a7b2023 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: e7e5215b-7f52-4485-9995-10958c4c3006] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:02.245290 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fc8199bc-d7d8-4914-8161-d8735a7b2023 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:02.245873 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fc8199bc-d7d8-4914-8161-d8735a7b2023 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:02.246387 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fc8199bc-d7d8-4914-8161-d8735a7b2023 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:02.247423 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fc8199bc-d7d8-4914-8161-d8735a7b2023 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:02.247890 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fc8199bc-d7d8-4914-8161-d8735a7b2023 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:02.248311 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fc8199bc-d7d8-4914-8161-d8735a7b2023 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:02.363473 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-85addbf3-ca06-464a-b83c-b6eace52f5f3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:02.364736 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-85addbf3-ca06-464a-b83c-b6eace52f5f3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:02.371113 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-85addbf3-ca06-464a-b83c-b6eace52f5f3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:02.371683 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-85addbf3-ca06-464a-b83c-b6eace52f5f3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:02.372120 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-85addbf3-ca06-464a-b83c-b6eace52f5f3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:02.372806 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-85addbf3-ca06-464a-b83c-b6eace52f5f3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:02.373265 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-85addbf3-ca06-464a-b83c-b6eace52f5f3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:02.373665 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-85addbf3-ca06-464a-b83c-b6eace52f5f3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:02.510877 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-85addbf3-ca06-464a-b83c-b6eace52f5f3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:02.519779 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-85addbf3-ca06-464a-b83c-b6eace52f5f3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:02.521230 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-85addbf3-ca06-464a-b83c-b6eace52f5f3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:02.522683 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-85addbf3-ca06-464a-b83c-b6eace52f5f3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 200 len: 1721 microversion: 2.20 time: 0.163003 Aug 09 07:08:02.523234 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 355/718] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:08:02 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 07:08:03.180854 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-fc8199bc-d7d8-4914-8161-d8735a7b2023 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "POST /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.947922 Aug 09 07:08:03.187353 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 364/719] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Aug 9 07:08:02 2022] POST /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006/os-volume_attachments => generated 194 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:08:03.545444 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-72d79d9d-5f97-4297-a5d2-a44a60f1efc1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:03.546040 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-72d79d9d-5f97-4297-a5d2-a44a60f1efc1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:03.552334 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-72d79d9d-5f97-4297-a5d2-a44a60f1efc1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:03.552809 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-72d79d9d-5f97-4297-a5d2-a44a60f1efc1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:03.553240 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-72d79d9d-5f97-4297-a5d2-a44a60f1efc1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:03.553924 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-72d79d9d-5f97-4297-a5d2-a44a60f1efc1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:03.554369 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-72d79d9d-5f97-4297-a5d2-a44a60f1efc1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:03.554792 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-72d79d9d-5f97-4297-a5d2-a44a60f1efc1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:03.557288 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:08:03.707582 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-72d79d9d-5f97-4297-a5d2-a44a60f1efc1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:03.716298 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-72d79d9d-5f97-4297-a5d2-a44a60f1efc1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:03.717884 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-72d79d9d-5f97-4297-a5d2-a44a60f1efc1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:03.719034 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-72d79d9d-5f97-4297-a5d2-a44a60f1efc1 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 200 len: 1724 microversion: 2.20 time: 0.177581 Aug 09 07:08:03.719591 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 356/720] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:08:03 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:08:03.742703 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-9525d99d-2eab-4e83-b877-2b1f8b487ba0 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0cbee5c7-be9e-408a-9764-c8d6d81c9b36"}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:08:03.745183 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-9525d99d-2eab-4e83-b877-2b1f8b487ba0 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:03.751280 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9525d99d-2eab-4e83-b877-2b1f8b487ba0 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:03.751791 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9525d99d-2eab-4e83-b877-2b1f8b487ba0 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:03.752225 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9525d99d-2eab-4e83-b877-2b1f8b487ba0 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:03.753170 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9525d99d-2eab-4e83-b877-2b1f8b487ba0 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:03.753635 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9525d99d-2eab-4e83-b877-2b1f8b487ba0 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:03.754035 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9525d99d-2eab-4e83-b877-2b1f8b487ba0 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:04.035452 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-9525d99d-2eab-4e83-b877-2b1f8b487ba0 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "POST /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.297482 Aug 09 07:08:04.036109 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 365/721] 10.222.0.30 () {62 vars in 1364 bytes} [Tue Aug 9 07:08:03 2022] POST /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8/os-volume_attachments => generated 188 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 09 07:08:04.160372 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-984c52d7-dc6d-438f-af74-5aaa8bc9f5d7 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:04.160864 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-984c52d7-dc6d-438f-af74-5aaa8bc9f5d7 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:04.166605 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-984c52d7-dc6d-438f-af74-5aaa8bc9f5d7 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:04.167076 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-984c52d7-dc6d-438f-af74-5aaa8bc9f5d7 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:04.167506 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-984c52d7-dc6d-438f-af74-5aaa8bc9f5d7 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:04.168249 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-984c52d7-dc6d-438f-af74-5aaa8bc9f5d7 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:04.168702 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-984c52d7-dc6d-438f-af74-5aaa8bc9f5d7 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:04.169126 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-984c52d7-dc6d-438f-af74-5aaa8bc9f5d7 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:04.401046 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-984c52d7-dc6d-438f-af74-5aaa8bc9f5d7 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "DELETE /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8/os-volume_attachments/0cbee5c7-be9e-408a-9764-c8d6d81c9b36" status: 202 len: 0 microversion: 2.20 time: 0.244466 Aug 09 07:08:04.401818 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 357/722] 10.222.0.30 () {60 vars in 1457 bytes} [Tue Aug 9 07:08:04 2022] DELETE /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8/os-volume_attachments/0cbee5c7-be9e-408a-9764-c8d6d81c9b36 => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 07:08:04.463165 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6a1cefe4-a95a-4791-ba2e-efebb4badef0 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:08:04.463792 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-6a1cefe4-a95a-4791-ba2e-efebb4badef0 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:04.470426 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6a1cefe4-a95a-4791-ba2e-efebb4badef0 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:04.471083 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6a1cefe4-a95a-4791-ba2e-efebb4badef0 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:04.471680 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6a1cefe4-a95a-4791-ba2e-efebb4badef0 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:04.472531 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6a1cefe4-a95a-4791-ba2e-efebb4badef0 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:04.473344 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6a1cefe4-a95a-4791-ba2e-efebb4badef0 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:04.473889 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6a1cefe4-a95a-4791-ba2e-efebb4badef0 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:04.478019 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=8,nova_cell1:INSERT=5 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:08:04.508217 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-6a1cefe4-a95a-4791-ba2e-efebb4badef0 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117859) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 09 07:08:04.585362 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-6a1cefe4-a95a-4791-ba2e-efebb4badef0 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "POST /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8/action" status: 202 len: 0 microversion: 2.20 time: 0.126009 Aug 09 07:08:04.586125 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 366/723] 10.222.0.30 () {62 vars in 1319 bytes} [Tue Aug 9 07:08:04 2022] POST /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 09 07:08:04.594502 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-795db897-5210-4efd-8369-33b91ed7d72e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:04.595828 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-795db897-5210-4efd-8369-33b91ed7d72e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:04.602818 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-795db897-5210-4efd-8369-33b91ed7d72e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:04.603307 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-795db897-5210-4efd-8369-33b91ed7d72e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:04.603779 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-795db897-5210-4efd-8369-33b91ed7d72e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:04.604671 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-795db897-5210-4efd-8369-33b91ed7d72e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:04.605130 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-795db897-5210-4efd-8369-33b91ed7d72e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:04.605552 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-795db897-5210-4efd-8369-33b91ed7d72e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:04.747364 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-795db897-5210-4efd-8369-33b91ed7d72e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:04.756084 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-795db897-5210-4efd-8369-33b91ed7d72e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:04.757595 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-795db897-5210-4efd-8369-33b91ed7d72e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:04.758757 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-795db897-5210-4efd-8369-33b91ed7d72e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 200 len: 1672 microversion: 2.20 time: 0.168685 Aug 09 07:08:04.759318 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 358/724] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:08:04 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 1672 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:08:05.157505 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-6ab5dd34-b006-4008-8ad6-b5dc9869af94 req-003dcbde-17b2-4126-85cd-e7bc6264254a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf38e7a7-b39a-4966-aa2d-effc83a555b8", "name": "network-vif-unplugged", "status": "completed", "tag": "067648c9-4dd9-4848-a425-3cbbac00eedd"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:08:05.168115 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-6ab5dd34-b006-4008-8ad6-b5dc9869af94 req-003dcbde-17b2-4126-85cd-e7bc6264254a service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:05.168595 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-6ab5dd34-b006-4008-8ad6-b5dc9869af94 req-003dcbde-17b2-4126-85cd-e7bc6264254a service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:05.169027 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-6ab5dd34-b006-4008-8ad6-b5dc9869af94 req-003dcbde-17b2-4126-85cd-e7bc6264254a service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:05.180967 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.compute.server_external_events [req-6ab5dd34-b006-4008-8ad6-b5dc9869af94 req-003dcbde-17b2-4126-85cd-e7bc6264254a service nova] Unable to find a host for instance cf38e7a7-b39a-4966-aa2d-effc83a555b8. Dropping event network-vif-unplugged {{(pid=117859) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 09 07:08:05.185388 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-6ab5dd34-b006-4008-8ad6-b5dc9869af94 req-003dcbde-17b2-4126-85cd-e7bc6264254a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028233 Aug 09 07:08:05.186026 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 367/725] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 09 07:08:05.782547 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-7bcb0cd8-fad2-4678-95b3-d7a4192e1397 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:05.783414 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-7bcb0cd8-fad2-4678-95b3-d7a4192e1397 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:05.790874 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7bcb0cd8-fad2-4678-95b3-d7a4192e1397 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:05.791687 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7bcb0cd8-fad2-4678-95b3-d7a4192e1397 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:05.792132 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7bcb0cd8-fad2-4678-95b3-d7a4192e1397 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:05.794015 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7bcb0cd8-fad2-4678-95b3-d7a4192e1397 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:05.794737 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7bcb0cd8-fad2-4678-95b3-d7a4192e1397 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:05.795174 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7bcb0cd8-fad2-4678-95b3-d7a4192e1397 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:05.959299 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-7bcb0cd8-fad2-4678-95b3-d7a4192e1397 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:05.968847 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-7bcb0cd8-fad2-4678-95b3-d7a4192e1397 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:05.970357 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-7bcb0cd8-fad2-4678-95b3-d7a4192e1397 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:05.971525 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-7bcb0cd8-fad2-4678-95b3-d7a4192e1397 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 200 len: 1674 microversion: 2.20 time: 0.193820 Aug 09 07:08:05.972122 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 359/726] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:08:05 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 1674 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:08:06.004734 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-7d7d36f5-db94-4124-b47b-a99e1a1fdfd2 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:06.005386 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-7d7d36f5-db94-4124-b47b-a99e1a1fdfd2 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: f4e76bb7-6a13-4dbf-9062-4ba30c528398] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:06.011403 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7d7d36f5-db94-4124-b47b-a99e1a1fdfd2 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:06.012551 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7d7d36f5-db94-4124-b47b-a99e1a1fdfd2 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:06.013173 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7d7d36f5-db94-4124-b47b-a99e1a1fdfd2 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:06.014036 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7d7d36f5-db94-4124-b47b-a99e1a1fdfd2 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:06.014650 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7d7d36f5-db94-4124-b47b-a99e1a1fdfd2 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:06.015264 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7d7d36f5-db94-4124-b47b-a99e1a1fdfd2 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:06.039266 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-7d7d36f5-db94-4124-b47b-a99e1a1fdfd2 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/f4e76bb7-6a13-4dbf-9062-4ba30c528398/ips" status: 200 len: 150 microversion: 2.1 time: 0.231686 Aug 09 07:08:06.039915 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 368/727] 10.222.0.30 () {58 vars in 1248 bytes} [Tue Aug 9 07:08:05 2022] GET /compute/v2.1/servers/f4e76bb7-6a13-4dbf-9062-4ba30c528398/ips => generated 150 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:08:06.995712 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-7e08e205-74db-4ff3-b501-0c349728b807 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:06.996873 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-7e08e205-74db-4ff3-b501-0c349728b807 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:07.004111 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7e08e205-74db-4ff3-b501-0c349728b807 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:07.004603 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7e08e205-74db-4ff3-b501-0c349728b807 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:07.005031 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7e08e205-74db-4ff3-b501-0c349728b807 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:07.005721 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7e08e205-74db-4ff3-b501-0c349728b807 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:07.006168 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7e08e205-74db-4ff3-b501-0c349728b807 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:07.006592 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7e08e205-74db-4ff3-b501-0c349728b807 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:07.155536 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-7e08e205-74db-4ff3-b501-0c349728b807 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:07.164809 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-7e08e205-74db-4ff3-b501-0c349728b807 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:07.167136 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-7e08e205-74db-4ff3-b501-0c349728b807 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:07.169596 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-7e08e205-74db-4ff3-b501-0c349728b807 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 200 len: 1730 microversion: 2.20 time: 0.176502 Aug 09 07:08:07.170255 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 360/728] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:08:06 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 1730 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:08:07.379284 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-fda5a43a-5461-4793-be0b-50817a76b014 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "85c9b99f-a261-4fa9-9fc2-2f16d17f7022"}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:08:07.381705 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-fda5a43a-5461-4793-be0b-50817a76b014 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: f4e76bb7-6a13-4dbf-9062-4ba30c528398] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:07.388852 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fda5a43a-5461-4793-be0b-50817a76b014 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:07.389536 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fda5a43a-5461-4793-be0b-50817a76b014 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:07.390216 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fda5a43a-5461-4793-be0b-50817a76b014 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:07.390916 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fda5a43a-5461-4793-be0b-50817a76b014 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:07.391367 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fda5a43a-5461-4793-be0b-50817a76b014 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:07.391818 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fda5a43a-5461-4793-be0b-50817a76b014 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:08.193354 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-75e7dc95-b2d1-46ec-8be9-4a2fb5165f95 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:08.194130 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-75e7dc95-b2d1-46ec-8be9-4a2fb5165f95 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:08.200740 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-75e7dc95-b2d1-46ec-8be9-4a2fb5165f95 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:08.203229 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-75e7dc95-b2d1-46ec-8be9-4a2fb5165f95 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:08.203723 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-75e7dc95-b2d1-46ec-8be9-4a2fb5165f95 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:08.204447 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-75e7dc95-b2d1-46ec-8be9-4a2fb5165f95 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:08.204908 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-75e7dc95-b2d1-46ec-8be9-4a2fb5165f95 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:08.205330 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-75e7dc95-b2d1-46ec-8be9-4a2fb5165f95 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:08.348156 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-75e7dc95-b2d1-46ec-8be9-4a2fb5165f95 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:08.356757 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-75e7dc95-b2d1-46ec-8be9-4a2fb5165f95 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:08.358424 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-75e7dc95-b2d1-46ec-8be9-4a2fb5165f95 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:08.359588 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-75e7dc95-b2d1-46ec-8be9-4a2fb5165f95 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 200 len: 1730 microversion: 2.20 time: 0.170151 Aug 09 07:08:08.360185 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 361/729] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:08:08 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 07:08:09.388513 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-31337476-d33e-48f3-8770-76277d2d809e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:09.389126 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-31337476-d33e-48f3-8770-76277d2d809e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:09.396581 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-31337476-d33e-48f3-8770-76277d2d809e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:09.397070 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-31337476-d33e-48f3-8770-76277d2d809e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:09.397505 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-31337476-d33e-48f3-8770-76277d2d809e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:09.398233 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-31337476-d33e-48f3-8770-76277d2d809e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:09.398688 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-31337476-d33e-48f3-8770-76277d2d809e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:09.399131 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-31337476-d33e-48f3-8770-76277d2d809e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:09.548847 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-31337476-d33e-48f3-8770-76277d2d809e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:09.557369 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-31337476-d33e-48f3-8770-76277d2d809e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:09.559617 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-31337476-d33e-48f3-8770-76277d2d809e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:09.560976 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-31337476-d33e-48f3-8770-76277d2d809e tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 200 len: 1730 microversion: 2.20 time: 0.182072 Aug 09 07:08:09.568141 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 362/730] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:08:09 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 1730 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 07:08:10.585540 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-7583c83c-77e9-4c44-8471-dcd83e9abfaa tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:10.586238 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-7583c83c-77e9-4c44-8471-dcd83e9abfaa tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:10.592928 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7583c83c-77e9-4c44-8471-dcd83e9abfaa tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:10.593410 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7583c83c-77e9-4c44-8471-dcd83e9abfaa tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:10.593839 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7583c83c-77e9-4c44-8471-dcd83e9abfaa tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:10.594586 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7583c83c-77e9-4c44-8471-dcd83e9abfaa tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:10.594971 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7583c83c-77e9-4c44-8471-dcd83e9abfaa tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:10.595835 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7583c83c-77e9-4c44-8471-dcd83e9abfaa tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:10.742818 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-7583c83c-77e9-4c44-8471-dcd83e9abfaa tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:10.752752 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-7583c83c-77e9-4c44-8471-dcd83e9abfaa tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:10.754243 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-7583c83c-77e9-4c44-8471-dcd83e9abfaa tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:10.755404 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-7583c83c-77e9-4c44-8471-dcd83e9abfaa tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 200 len: 1730 microversion: 2.20 time: 0.173759 Aug 09 07:08:10.758632 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 363/731] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:08:10 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 07:08:11.779323 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-7b5684c7-0ea9-4f7a-836b-95f78846d91b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:11.780040 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-7b5684c7-0ea9-4f7a-836b-95f78846d91b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:11.786769 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7b5684c7-0ea9-4f7a-836b-95f78846d91b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:11.787260 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7b5684c7-0ea9-4f7a-836b-95f78846d91b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:11.787731 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7b5684c7-0ea9-4f7a-836b-95f78846d91b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:11.788436 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7b5684c7-0ea9-4f7a-836b-95f78846d91b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:11.788899 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7b5684c7-0ea9-4f7a-836b-95f78846d91b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:11.789327 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7b5684c7-0ea9-4f7a-836b-95f78846d91b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:11.940625 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-7b5684c7-0ea9-4f7a-836b-95f78846d91b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:11.951647 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-7b5684c7-0ea9-4f7a-836b-95f78846d91b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:11.954029 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-7b5684c7-0ea9-4f7a-836b-95f78846d91b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:11.955199 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-7b5684c7-0ea9-4f7a-836b-95f78846d91b tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 200 len: 1730 microversion: 2.20 time: 0.180658 Aug 09 07:08:11.956034 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 364/732] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:08:11 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 07:08:12.982293 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-9b046d43-da7c-4f6e-bb1c-5232744093a5 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:12.983760 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-9b046d43-da7c-4f6e-bb1c-5232744093a5 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:12.991266 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9b046d43-da7c-4f6e-bb1c-5232744093a5 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:12.992278 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9b046d43-da7c-4f6e-bb1c-5232744093a5 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:12.992925 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9b046d43-da7c-4f6e-bb1c-5232744093a5 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:12.993822 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9b046d43-da7c-4f6e-bb1c-5232744093a5 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:12.994286 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9b046d43-da7c-4f6e-bb1c-5232744093a5 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:12.995040 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9b046d43-da7c-4f6e-bb1c-5232744093a5 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:13.213565 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-9b046d43-da7c-4f6e-bb1c-5232744093a5 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:13.228832 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-9b046d43-da7c-4f6e-bb1c-5232744093a5 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:13.234430 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-9b046d43-da7c-4f6e-bb1c-5232744093a5 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:13.236018 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-9b046d43-da7c-4f6e-bb1c-5232744093a5 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 200 len: 1730 microversion: 2.20 time: 0.258233 Aug 09 07:08:13.236670 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 365/733] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:08:12 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 1730 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 07:08:14.270800 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-ca297869-6903-4f8e-bd02-60a8ae144953 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:14.272237 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-ca297869-6903-4f8e-bd02-60a8ae144953 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:14.280258 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ca297869-6903-4f8e-bd02-60a8ae144953 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:14.281012 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ca297869-6903-4f8e-bd02-60a8ae144953 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:14.281663 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ca297869-6903-4f8e-bd02-60a8ae144953 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:14.282869 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ca297869-6903-4f8e-bd02-60a8ae144953 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:14.283385 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ca297869-6903-4f8e-bd02-60a8ae144953 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:14.283899 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ca297869-6903-4f8e-bd02-60a8ae144953 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:14.436545 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-ca297869-6903-4f8e-bd02-60a8ae144953 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:14.448167 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-ca297869-6903-4f8e-bd02-60a8ae144953 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:14.450702 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-ca297869-6903-4f8e-bd02-60a8ae144953 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:14.454516 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-ca297869-6903-4f8e-bd02-60a8ae144953 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 200 len: 1730 microversion: 2.20 time: 0.189640 Aug 09 07:08:14.466496 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 366/734] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:08:14 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 1730 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 07:08:15.478347 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-d3906dc2-25bc-4a16-8ba6-403563851de9 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:15.479057 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-d3906dc2-25bc-4a16-8ba6-403563851de9 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:15.485419 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d3906dc2-25bc-4a16-8ba6-403563851de9 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:15.485893 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d3906dc2-25bc-4a16-8ba6-403563851de9 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:15.486615 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d3906dc2-25bc-4a16-8ba6-403563851de9 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:15.487051 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d3906dc2-25bc-4a16-8ba6-403563851de9 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:15.487541 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d3906dc2-25bc-4a16-8ba6-403563851de9 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:15.488085 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d3906dc2-25bc-4a16-8ba6-403563851de9 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:15.623990 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-d3906dc2-25bc-4a16-8ba6-403563851de9 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:15.632889 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-d3906dc2-25bc-4a16-8ba6-403563851de9 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:15.634430 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-d3906dc2-25bc-4a16-8ba6-403563851de9 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:15.635584 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-d3906dc2-25bc-4a16-8ba6-403563851de9 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 200 len: 1730 microversion: 2.20 time: 0.161182 Aug 09 07:08:15.636161 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 367/735] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:08:15 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 07:08:15.941830 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-fda5a43a-5461-4793-be0b-50817a76b014 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "POST /compute/v2.1/servers/f4e76bb7-6a13-4dbf-9062-4ba30c528398/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.566499 Aug 09 07:08:15.942436 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 369/736] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Aug 9 07:08:07 2022] POST /compute/v2.1/servers/f4e76bb7-6a13-4dbf-9062-4ba30c528398/os-volume_attachments => generated 194 bytes in 8568 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:08:16.658281 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-9afdc729-763a-4def-aef6-0268d49a37c3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:16.658913 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-9afdc729-763a-4def-aef6-0268d49a37c3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:16.665254 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9afdc729-763a-4def-aef6-0268d49a37c3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:16.665734 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9afdc729-763a-4def-aef6-0268d49a37c3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:16.666165 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9afdc729-763a-4def-aef6-0268d49a37c3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:16.666847 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9afdc729-763a-4def-aef6-0268d49a37c3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:16.667297 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9afdc729-763a-4def-aef6-0268d49a37c3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:16.668276 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9afdc729-763a-4def-aef6-0268d49a37c3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:16.799477 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-9afdc729-763a-4def-aef6-0268d49a37c3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:16.810251 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-9afdc729-763a-4def-aef6-0268d49a37c3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:16.811770 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-9afdc729-763a-4def-aef6-0268d49a37c3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:16.812924 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-9afdc729-763a-4def-aef6-0268d49a37c3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 200 len: 1730 microversion: 2.20 time: 0.158566 Aug 09 07:08:16.813556 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 368/737] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:08:16 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:08:17.833275 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:08:17.837441 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-07496ab6-8ebb-4728-ba77-e113a0ad044a tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:17.838134 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-07496ab6-8ebb-4728-ba77-e113a0ad044a tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:17.846554 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-07496ab6-8ebb-4728-ba77-e113a0ad044a tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:17.847036 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-07496ab6-8ebb-4728-ba77-e113a0ad044a tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:17.847472 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-07496ab6-8ebb-4728-ba77-e113a0ad044a tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:17.848196 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-07496ab6-8ebb-4728-ba77-e113a0ad044a tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:17.848644 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-07496ab6-8ebb-4728-ba77-e113a0ad044a tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:17.849086 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-07496ab6-8ebb-4728-ba77-e113a0ad044a tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:17.978567 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-07496ab6-8ebb-4728-ba77-e113a0ad044a tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:17.986557 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-07496ab6-8ebb-4728-ba77-e113a0ad044a tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:17.988083 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-07496ab6-8ebb-4728-ba77-e113a0ad044a tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:17.989227 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-07496ab6-8ebb-4728-ba77-e113a0ad044a tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 200 len: 1730 microversion: 2.20 time: 0.157490 Aug 09 07:08:17.989780 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 370/738] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:08:17 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:08:19.013809 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-5191a5b0-320a-4afd-8215-a3afef141088 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:19.014440 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-5191a5b0-320a-4afd-8215-a3afef141088 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:19.020823 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5191a5b0-320a-4afd-8215-a3afef141088 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:19.022443 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5191a5b0-320a-4afd-8215-a3afef141088 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:19.022443 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5191a5b0-320a-4afd-8215-a3afef141088 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:19.022887 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5191a5b0-320a-4afd-8215-a3afef141088 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:19.026552 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5191a5b0-320a-4afd-8215-a3afef141088 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:19.032962 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5191a5b0-320a-4afd-8215-a3afef141088 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:19.204455 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-5191a5b0-320a-4afd-8215-a3afef141088 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:19.212247 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-5191a5b0-320a-4afd-8215-a3afef141088 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:19.213721 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-5191a5b0-320a-4afd-8215-a3afef141088 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:19.215616 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-5191a5b0-320a-4afd-8215-a3afef141088 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 200 len: 1730 microversion: 2.20 time: 0.206703 Aug 09 07:08:19.216186 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 369/739] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:08:19 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 1730 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:08:20.238711 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d5282743-6b9c-4938-b402-61349d9d2b9d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:20.239315 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-d5282743-6b9c-4938-b402-61349d9d2b9d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:20.246720 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d5282743-6b9c-4938-b402-61349d9d2b9d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:20.247208 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d5282743-6b9c-4938-b402-61349d9d2b9d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:20.247669 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d5282743-6b9c-4938-b402-61349d9d2b9d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:20.248380 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d5282743-6b9c-4938-b402-61349d9d2b9d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:20.249160 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d5282743-6b9c-4938-b402-61349d9d2b9d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:20.249877 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d5282743-6b9c-4938-b402-61349d9d2b9d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:20.403932 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d5282743-6b9c-4938-b402-61349d9d2b9d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:20.411956 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d5282743-6b9c-4938-b402-61349d9d2b9d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:20.413502 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d5282743-6b9c-4938-b402-61349d9d2b9d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:20.414662 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-d5282743-6b9c-4938-b402-61349d9d2b9d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 200 len: 1730 microversion: 2.20 time: 0.180215 Aug 09 07:08:20.415212 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 371/740] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:08:20 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 1730 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:08:21.440549 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-c3b99f0f-f290-40e7-941a-03e7315827b9 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:21.441158 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-c3b99f0f-f290-40e7-941a-03e7315827b9 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:21.447472 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c3b99f0f-f290-40e7-941a-03e7315827b9 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:21.447993 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c3b99f0f-f290-40e7-941a-03e7315827b9 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:21.448438 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c3b99f0f-f290-40e7-941a-03e7315827b9 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:21.449266 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c3b99f0f-f290-40e7-941a-03e7315827b9 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:21.449775 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c3b99f0f-f290-40e7-941a-03e7315827b9 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:21.450204 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c3b99f0f-f290-40e7-941a-03e7315827b9 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:21.454120 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:08:21.579900 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-c3b99f0f-f290-40e7-941a-03e7315827b9 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:21.587745 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-c3b99f0f-f290-40e7-941a-03e7315827b9 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:21.589841 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-c3b99f0f-f290-40e7-941a-03e7315827b9 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:21.591132 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-c3b99f0f-f290-40e7-941a-03e7315827b9 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 200 len: 1730 microversion: 2.20 time: 0.154383 Aug 09 07:08:21.591713 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 370/741] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:08:21 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 09 07:08:22.613732 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-bf9543d3-3af0-4c5c-9b07-abce0e643aa3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:22.614341 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-bf9543d3-3af0-4c5c-9b07-abce0e643aa3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:22.621656 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bf9543d3-3af0-4c5c-9b07-abce0e643aa3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:22.622234 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bf9543d3-3af0-4c5c-9b07-abce0e643aa3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:22.622675 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bf9543d3-3af0-4c5c-9b07-abce0e643aa3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:22.623366 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bf9543d3-3af0-4c5c-9b07-abce0e643aa3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:22.623848 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bf9543d3-3af0-4c5c-9b07-abce0e643aa3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:22.624306 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bf9543d3-3af0-4c5c-9b07-abce0e643aa3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:22.759385 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-bf9543d3-3af0-4c5c-9b07-abce0e643aa3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:22.767497 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-bf9543d3-3af0-4c5c-9b07-abce0e643aa3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:22.769011 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-bf9543d3-3af0-4c5c-9b07-abce0e643aa3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:22.770180 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-bf9543d3-3af0-4c5c-9b07-abce0e643aa3 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 200 len: 1730 microversion: 2.20 time: 0.160301 Aug 09 07:08:22.770736 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 372/742] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:08:22 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:08:23.264220 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [req-0cf7152c-330e-43a5-9b1b-c0c13850175a req-164ff900-4e18-42fc-8706-f0e0ab653176 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf38e7a7-b39a-4966-aa2d-effc83a555b8", "name": "network-vif-plugged", "status": "completed", "tag": "067648c9-4dd9-4848-a425-3cbbac00eedd"}]} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:08:23.273474 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-0cf7152c-330e-43a5-9b1b-c0c13850175a req-164ff900-4e18-42fc-8706-f0e0ab653176 service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:23.273946 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-0cf7152c-330e-43a5-9b1b-c0c13850175a req-164ff900-4e18-42fc-8706-f0e0ab653176 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:23.274377 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-0cf7152c-330e-43a5-9b1b-c0c13850175a req-164ff900-4e18-42fc-8706-f0e0ab653176 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:23.285639 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.compute.server_external_events [req-0cf7152c-330e-43a5-9b1b-c0c13850175a req-164ff900-4e18-42fc-8706-f0e0ab653176 service nova] Creating event network-vif-plugged:067648c9-4dd9-4848-a425-3cbbac00eedd for instance cf38e7a7-b39a-4966-aa2d-effc83a555b8 on hv-cinder-85251 Aug 09 07:08:23.290508 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [req-0cf7152c-330e-43a5-9b1b-c0c13850175a req-164ff900-4e18-42fc-8706-f0e0ab653176 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153939 Aug 09 07:08:23.291016 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 371/743] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:08:23.606348 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f4c3b7d7-54c3-46a4-a658-98d1651763e2 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:23.608616 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-f4c3b7d7-54c3-46a4-a658-98d1651763e2 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: e7e5215b-7f52-4485-9995-10958c4c3006] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:23.614901 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f4c3b7d7-54c3-46a4-a658-98d1651763e2 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:23.615471 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f4c3b7d7-54c3-46a4-a658-98d1651763e2 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:23.615851 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f4c3b7d7-54c3-46a4-a658-98d1651763e2 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:23.616541 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f4c3b7d7-54c3-46a4-a658-98d1651763e2 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:23.616994 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f4c3b7d7-54c3-46a4-a658-98d1651763e2 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:23.617438 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f4c3b7d7-54c3-46a4-a658-98d1651763e2 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:23.649082 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f4c3b7d7-54c3-46a4-a658-98d1651763e2 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047279 Aug 09 07:08:23.649635 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 373/744] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 9 07:08:23 2022] GET /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:08:23.794801 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-98b14133-f7ba-4b6c-9a0d-e47388296997 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:23.795497 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-98b14133-f7ba-4b6c-9a0d-e47388296997 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:23.799539 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6cc9f1e1-8ce5-4131-aac9-7fe89b410131 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:23.800120 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-6cc9f1e1-8ce5-4131-aac9-7fe89b410131 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: e7e5215b-7f52-4485-9995-10958c4c3006] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:23.801693 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-98b14133-f7ba-4b6c-9a0d-e47388296997 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:23.802170 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-98b14133-f7ba-4b6c-9a0d-e47388296997 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:23.802985 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-98b14133-f7ba-4b6c-9a0d-e47388296997 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:23.803300 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-98b14133-f7ba-4b6c-9a0d-e47388296997 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:23.803779 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-98b14133-f7ba-4b6c-9a0d-e47388296997 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:23.804206 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-98b14133-f7ba-4b6c-9a0d-e47388296997 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:23.805978 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6cc9f1e1-8ce5-4131-aac9-7fe89b410131 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:23.806454 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6cc9f1e1-8ce5-4131-aac9-7fe89b410131 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:23.806888 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6cc9f1e1-8ce5-4131-aac9-7fe89b410131 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:23.807575 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6cc9f1e1-8ce5-4131-aac9-7fe89b410131 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:23.808920 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6cc9f1e1-8ce5-4131-aac9-7fe89b410131 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:23.809362 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6cc9f1e1-8ce5-4131-aac9-7fe89b410131 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:23.847032 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-6cc9f1e1-8ce5-4131-aac9-7fe89b410131 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006/os-volume_attachments/4c2f3d81-045f-4c12-b35b-1ff5e83c32a6" status: 200 len: 194 microversion: 2.1 time: 0.051922 Aug 09 07:08:23.847661 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 374/745] 10.222.0.30 () {58 vars in 1413 bytes} [Tue Aug 9 07:08:23 2022] GET /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006/os-volume_attachments/4c2f3d81-045f-4c12-b35b-1ff5e83c32a6 => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 07:08:23.858678 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6e93162c-fca9-4c97-ab68-b8c8f81e7ee7 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:23.859236 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-6e93162c-fca9-4c97-ab68-b8c8f81e7ee7 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: e7e5215b-7f52-4485-9995-10958c4c3006] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:23.872972 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6e93162c-fca9-4c97-ab68-b8c8f81e7ee7 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:23.873465 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6e93162c-fca9-4c97-ab68-b8c8f81e7ee7 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:23.873894 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6e93162c-fca9-4c97-ab68-b8c8f81e7ee7 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:23.874943 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6e93162c-fca9-4c97-ab68-b8c8f81e7ee7 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:23.875403 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6e93162c-fca9-4c97-ab68-b8c8f81e7ee7 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:23.875867 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6e93162c-fca9-4c97-ab68-b8c8f81e7ee7 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:23.953302 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-98b14133-f7ba-4b6c-9a0d-e47388296997 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:23.966947 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-98b14133-f7ba-4b6c-9a0d-e47388296997 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:23.968511 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-98b14133-f7ba-4b6c-9a0d-e47388296997 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:23.970228 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-98b14133-f7ba-4b6c-9a0d-e47388296997 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 200 len: 1730 microversion: 2.20 time: 0.180327 Aug 09 07:08:23.971171 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 372/746] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:08:23 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:08:23.981630 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.objects.instance [None req-6e93162c-fca9-4c97-ab68-b8c8f81e7ee7 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lazy-loading 'services' on Instance uuid e7e5215b-7f52-4485-9995-10958c4c3006 {{(pid=117859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 07:08:24.054426 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-6e93162c-fca9-4c97-ab68-b8c8f81e7ee7 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006/os-volume_attachments/4c2f3d81-045f-4c12-b35b-1ff5e83c32a6" status: 202 len: 0 microversion: 2.1 time: 0.200338 Aug 09 07:08:24.054948 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 375/747] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Aug 9 07:08:23 2022] DELETE /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006/os-volume_attachments/4c2f3d81-045f-4c12-b35b-1ff5e83c32a6 => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 07:08:24.993907 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-3beaaec0-1863-4f42-a476-7e765a3905f8 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:24.994453 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-3beaaec0-1863-4f42-a476-7e765a3905f8 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:25.001802 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3beaaec0-1863-4f42-a476-7e765a3905f8 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:25.002280 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3beaaec0-1863-4f42-a476-7e765a3905f8 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:25.002964 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3beaaec0-1863-4f42-a476-7e765a3905f8 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:25.003688 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3beaaec0-1863-4f42-a476-7e765a3905f8 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:25.004138 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3beaaec0-1863-4f42-a476-7e765a3905f8 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:25.004557 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3beaaec0-1863-4f42-a476-7e765a3905f8 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:25.158047 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-3beaaec0-1863-4f42-a476-7e765a3905f8 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:25.168488 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-3beaaec0-1863-4f42-a476-7e765a3905f8 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:25.170421 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-3beaaec0-1863-4f42-a476-7e765a3905f8 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:25.172011 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-3beaaec0-1863-4f42-a476-7e765a3905f8 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 200 len: 1730 microversion: 2.20 time: 0.182020 Aug 09 07:08:25.178923 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 373/748] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:08:24 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 1730 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:08:26.195653 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-70962575-1a6d-426f-b93c-3823ac989cb6 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:26.196384 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-70962575-1a6d-426f-b93c-3823ac989cb6 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:26.203325 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-70962575-1a6d-426f-b93c-3823ac989cb6 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:26.203844 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-70962575-1a6d-426f-b93c-3823ac989cb6 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:26.204281 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-70962575-1a6d-426f-b93c-3823ac989cb6 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:26.204967 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-70962575-1a6d-426f-b93c-3823ac989cb6 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:26.205415 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-70962575-1a6d-426f-b93c-3823ac989cb6 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:26.205835 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-70962575-1a6d-426f-b93c-3823ac989cb6 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:26.335086 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-70962575-1a6d-426f-b93c-3823ac989cb6 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:26.343860 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-70962575-1a6d-426f-b93c-3823ac989cb6 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:26.345360 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-70962575-1a6d-426f-b93c-3823ac989cb6 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:26.346507 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-70962575-1a6d-426f-b93c-3823ac989cb6 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 200 len: 1717 microversion: 2.20 time: 0.155598 Aug 09 07:08:26.347066 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 376/749] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:08:26 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 1717 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:08:31.172747 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-89ec8acf-3954-4fc3-b9c8-44400a097691 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:31.173238 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-89ec8acf-3954-4fc3-b9c8-44400a097691 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: f4e76bb7-6a13-4dbf-9062-4ba30c528398] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:31.175769 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_api:SELECT=46 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:08:31.181514 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-89ec8acf-3954-4fc3-b9c8-44400a097691 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:31.181999 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-89ec8acf-3954-4fc3-b9c8-44400a097691 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:31.182442 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-89ec8acf-3954-4fc3-b9c8-44400a097691 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:31.183285 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-89ec8acf-3954-4fc3-b9c8-44400a097691 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:31.183785 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-89ec8acf-3954-4fc3-b9c8-44400a097691 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:31.184267 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-89ec8acf-3954-4fc3-b9c8-44400a097691 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:31.272803 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.objects.instance [None req-89ec8acf-3954-4fc3-b9c8-44400a097691 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lazy-loading 'services' on Instance uuid f4e76bb7-6a13-4dbf-9062-4ba30c528398 {{(pid=117858) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 07:08:31.344631 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-89ec8acf-3954-4fc3-b9c8-44400a097691 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f4e76bb7-6a13-4dbf-9062-4ba30c528398/os-volume_attachments/85c9b99f-a261-4fa9-9fc2-2f16d17f7022" status: 202 len: 0 microversion: 2.1 time: 0.177143 Aug 09 07:08:31.345208 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 374/750] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Aug 9 07:08:31 2022] DELETE /compute/v2.1/servers/f4e76bb7-6a13-4dbf-9062-4ba30c528398/os-volume_attachments/85c9b99f-a261-4fa9-9fc2-2f16d17f7022 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 07:08:31.354260 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2d1e0936-b70e-4f4a-a31a-d514d5256492 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:31.356627 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-2d1e0936-b70e-4f4a-a31a-d514d5256492 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: f4e76bb7-6a13-4dbf-9062-4ba30c528398] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:31.363481 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2d1e0936-b70e-4f4a-a31a-d514d5256492 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:31.364072 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2d1e0936-b70e-4f4a-a31a-d514d5256492 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:31.364508 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2d1e0936-b70e-4f4a-a31a-d514d5256492 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:31.365210 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2d1e0936-b70e-4f4a-a31a-d514d5256492 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:31.365669 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2d1e0936-b70e-4f4a-a31a-d514d5256492 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:31.366094 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2d1e0936-b70e-4f4a-a31a-d514d5256492 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:31.397491 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-2d1e0936-b70e-4f4a-a31a-d514d5256492 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/f4e76bb7-6a13-4dbf-9062-4ba30c528398/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047705 Aug 09 07:08:31.398047 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 377/751] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 9 07:08:31 2022] GET /compute/v2.1/servers/f4e76bb7-6a13-4dbf-9062-4ba30c528398/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:08:31.532060 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-fce137b4-39cb-44c0-ab2f-e1bbcaa4ab13 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:31.532691 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-fce137b4-39cb-44c0-ab2f-e1bbcaa4ab13 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: e7e5215b-7f52-4485-9995-10958c4c3006] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:31.538672 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-fce137b4-39cb-44c0-ab2f-e1bbcaa4ab13 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:31.539149 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-fce137b4-39cb-44c0-ab2f-e1bbcaa4ab13 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:31.539581 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-fce137b4-39cb-44c0-ab2f-e1bbcaa4ab13 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:31.540303 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-fce137b4-39cb-44c0-ab2f-e1bbcaa4ab13 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:31.540742 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-fce137b4-39cb-44c0-ab2f-e1bbcaa4ab13 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:31.541163 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-fce137b4-39cb-44c0-ab2f-e1bbcaa4ab13 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:31.572261 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-fce137b4-39cb-44c0-ab2f-e1bbcaa4ab13 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006/os-volume_attachments/c3025662-90bb-416c-bd16-c14175231a04" status: 200 len: 194 microversion: 2.1 time: 0.045671 Aug 09 07:08:31.572771 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 375/752] 10.222.0.30 () {58 vars in 1413 bytes} [Tue Aug 9 07:08:31 2022] GET /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006/os-volume_attachments/c3025662-90bb-416c-bd16-c14175231a04 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:08:31.583734 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-82d7c781-cca3-4763-85a2-0d0bb9b525c4 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:31.584237 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-82d7c781-cca3-4763-85a2-0d0bb9b525c4 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: e7e5215b-7f52-4485-9995-10958c4c3006] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:31.590780 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-82d7c781-cca3-4763-85a2-0d0bb9b525c4 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:31.591272 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-82d7c781-cca3-4763-85a2-0d0bb9b525c4 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:31.591748 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-82d7c781-cca3-4763-85a2-0d0bb9b525c4 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:31.592446 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-82d7c781-cca3-4763-85a2-0d0bb9b525c4 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:31.592946 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-82d7c781-cca3-4763-85a2-0d0bb9b525c4 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:31.593379 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-82d7c781-cca3-4763-85a2-0d0bb9b525c4 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:31.676030 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.objects.instance [None req-82d7c781-cca3-4763-85a2-0d0bb9b525c4 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lazy-loading 'services' on Instance uuid e7e5215b-7f52-4485-9995-10958c4c3006 {{(pid=117859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 07:08:31.748245 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-82d7c781-cca3-4763-85a2-0d0bb9b525c4 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006/os-volume_attachments/c3025662-90bb-416c-bd16-c14175231a04" status: 202 len: 0 microversion: 2.1 time: 0.168293 Aug 09 07:08:31.748822 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 378/753] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Aug 9 07:08:31 2022] DELETE /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006/os-volume_attachments/c3025662-90bb-416c-bd16-c14175231a04 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 07:08:32.411089 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-a7317324-9d3b-4b9e-b45a-d7605be8cea8 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:32.414543 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-a7317324-9d3b-4b9e-b45a-d7605be8cea8 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: f4e76bb7-6a13-4dbf-9062-4ba30c528398] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:32.421826 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a7317324-9d3b-4b9e-b45a-d7605be8cea8 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:32.422322 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a7317324-9d3b-4b9e-b45a-d7605be8cea8 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:32.422802 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a7317324-9d3b-4b9e-b45a-d7605be8cea8 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:32.423486 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a7317324-9d3b-4b9e-b45a-d7605be8cea8 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:32.423975 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a7317324-9d3b-4b9e-b45a-d7605be8cea8 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:32.424479 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a7317324-9d3b-4b9e-b45a-d7605be8cea8 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:32.460177 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-a7317324-9d3b-4b9e-b45a-d7605be8cea8 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/f4e76bb7-6a13-4dbf-9062-4ba30c528398/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053259 Aug 09 07:08:32.460800 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 376/754] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 9 07:08:32 2022] GET /compute/v2.1/servers/f4e76bb7-6a13-4dbf-9062-4ba30c528398/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 07:08:32.533394 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-7a9c0cfe-2572-4db1-a218-223eb5d083b0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:32.534142 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-7a9c0cfe-2572-4db1-a218-223eb5d083b0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: f4e76bb7-6a13-4dbf-9062-4ba30c528398] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:32.540331 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7a9c0cfe-2572-4db1-a218-223eb5d083b0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:32.540878 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7a9c0cfe-2572-4db1-a218-223eb5d083b0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:32.541311 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7a9c0cfe-2572-4db1-a218-223eb5d083b0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:32.542679 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7a9c0cfe-2572-4db1-a218-223eb5d083b0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:32.543138 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7a9c0cfe-2572-4db1-a218-223eb5d083b0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:32.543549 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7a9c0cfe-2572-4db1-a218-223eb5d083b0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:32.568958 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-7a9c0cfe-2572-4db1-a218-223eb5d083b0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: f4e76bb7-6a13-4dbf-9062-4ba30c528398] Going to try to terminate instance {{(pid=117859) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 07:08:32.583068 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:08:32.654860 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-7a9c0cfe-2572-4db1-a218-223eb5d083b0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f4e76bb7-6a13-4dbf-9062-4ba30c528398" status: 204 len: 0 microversion: 2.1 time: 0.125552 Aug 09 07:08:32.655624 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 379/755] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 9 07:08:32 2022] DELETE /compute/v2.1/servers/f4e76bb7-6a13-4dbf-9062-4ba30c528398 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 07:08:32.664599 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-070a7c3e-f01d-4492-bed3-3408aed3091d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:32.665236 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-070a7c3e-f01d-4492-bed3-3408aed3091d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: f4e76bb7-6a13-4dbf-9062-4ba30c528398] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:32.672347 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-070a7c3e-f01d-4492-bed3-3408aed3091d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:32.672827 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-070a7c3e-f01d-4492-bed3-3408aed3091d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:32.673440 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-070a7c3e-f01d-4492-bed3-3408aed3091d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:32.674583 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-070a7c3e-f01d-4492-bed3-3408aed3091d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:32.675087 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-070a7c3e-f01d-4492-bed3-3408aed3091d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:32.675690 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-070a7c3e-f01d-4492-bed3-3408aed3091d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:32.813861 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-070a7c3e-f01d-4492-bed3-3408aed3091d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:32.822010 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-070a7c3e-f01d-4492-bed3-3408aed3091d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/f4e76bb7-6a13-4dbf-9062-4ba30c528398" status: 200 len: 1682 microversion: 2.1 time: 0.161895 Aug 09 07:08:32.822520 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 377/756] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:08:32 2022] GET /compute/v2.1/servers/f4e76bb7-6a13-4dbf-9062-4ba30c528398 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:08:32.924222 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-934e1539-3e1b-43ed-a809-f5eb430290b9 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:32.926545 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-934e1539-3e1b-43ed-a809-f5eb430290b9 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: e7e5215b-7f52-4485-9995-10958c4c3006] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:32.932548 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-934e1539-3e1b-43ed-a809-f5eb430290b9 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:32.933116 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-934e1539-3e1b-43ed-a809-f5eb430290b9 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:32.933546 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-934e1539-3e1b-43ed-a809-f5eb430290b9 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:32.934236 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-934e1539-3e1b-43ed-a809-f5eb430290b9 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:32.934692 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-934e1539-3e1b-43ed-a809-f5eb430290b9 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:32.935119 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-934e1539-3e1b-43ed-a809-f5eb430290b9 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:32.963082 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-934e1539-3e1b-43ed-a809-f5eb430290b9 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043148 Aug 09 07:08:32.963686 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 380/757] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 9 07:08:32 2022] GET /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 07:08:33.074513 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-dbb2abd9-ac03-4dcf-8d51-e192987b8aad tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:33.076781 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-dbb2abd9-ac03-4dcf-8d51-e192987b8aad tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: e7e5215b-7f52-4485-9995-10958c4c3006] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:33.082559 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-dbb2abd9-ac03-4dcf-8d51-e192987b8aad tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:33.083042 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-dbb2abd9-ac03-4dcf-8d51-e192987b8aad tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:33.083476 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-dbb2abd9-ac03-4dcf-8d51-e192987b8aad tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:33.084188 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-dbb2abd9-ac03-4dcf-8d51-e192987b8aad tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:33.084640 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-dbb2abd9-ac03-4dcf-8d51-e192987b8aad tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:33.085062 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-dbb2abd9-ac03-4dcf-8d51-e192987b8aad tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:33.113914 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-dbb2abd9-ac03-4dcf-8d51-e192987b8aad tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043891 Aug 09 07:08:33.114477 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 378/758] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 9 07:08:33 2022] GET /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 09 07:08:33.176087 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-75769211-965a-4cde-a20a-cae1539f6303 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:33.176588 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-75769211-965a-4cde-a20a-cae1539f6303 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: e7e5215b-7f52-4485-9995-10958c4c3006] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:33.182974 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-75769211-965a-4cde-a20a-cae1539f6303 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:33.183523 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-75769211-965a-4cde-a20a-cae1539f6303 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:33.184021 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-75769211-965a-4cde-a20a-cae1539f6303 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:33.184767 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-75769211-965a-4cde-a20a-cae1539f6303 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:33.185237 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-75769211-965a-4cde-a20a-cae1539f6303 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:33.185666 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-75769211-965a-4cde-a20a-cae1539f6303 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:33.211712 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-75769211-965a-4cde-a20a-cae1539f6303 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: e7e5215b-7f52-4485-9995-10958c4c3006] Going to try to terminate instance {{(pid=117859) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 07:08:33.284965 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-75769211-965a-4cde-a20a-cae1539f6303 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006" status: 204 len: 0 microversion: 2.1 time: 0.112328 Aug 09 07:08:33.285483 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 381/759] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 9 07:08:33 2022] DELETE /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 07:08:33.293724 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-793474d4-4b11-4578-8913-67833e7c11cd tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:33.294329 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-793474d4-4b11-4578-8913-67833e7c11cd tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: e7e5215b-7f52-4485-9995-10958c4c3006] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:33.300119 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-793474d4-4b11-4578-8913-67833e7c11cd tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:33.300598 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-793474d4-4b11-4578-8913-67833e7c11cd tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:33.301031 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-793474d4-4b11-4578-8913-67833e7c11cd tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:33.301707 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-793474d4-4b11-4578-8913-67833e7c11cd tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:33.302156 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-793474d4-4b11-4578-8913-67833e7c11cd tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:33.302573 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-793474d4-4b11-4578-8913-67833e7c11cd tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:33.431275 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-793474d4-4b11-4578-8913-67833e7c11cd tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:33.439333 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-793474d4-4b11-4578-8913-67833e7c11cd tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006" status: 200 len: 1673 microversion: 2.1 time: 0.149586 Aug 09 07:08:33.439968 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 379/760] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:08:33 2022] GET /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006 => generated 1673 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:08:33.844215 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6d7cdf3d-12f0-4e41-bb06-7bd1eb013fdc tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:33.845464 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-6d7cdf3d-12f0-4e41-bb06-7bd1eb013fdc tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: f4e76bb7-6a13-4dbf-9062-4ba30c528398] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:33.851971 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6d7cdf3d-12f0-4e41-bb06-7bd1eb013fdc tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:33.852518 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6d7cdf3d-12f0-4e41-bb06-7bd1eb013fdc tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:33.853015 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6d7cdf3d-12f0-4e41-bb06-7bd1eb013fdc tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:33.853715 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6d7cdf3d-12f0-4e41-bb06-7bd1eb013fdc tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:33.854160 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6d7cdf3d-12f0-4e41-bb06-7bd1eb013fdc tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:33.855511 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6d7cdf3d-12f0-4e41-bb06-7bd1eb013fdc tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:33.994372 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6d7cdf3d-12f0-4e41-bb06-7bd1eb013fdc tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:34.002191 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-6d7cdf3d-12f0-4e41-bb06-7bd1eb013fdc tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/f4e76bb7-6a13-4dbf-9062-4ba30c528398" status: 200 len: 1682 microversion: 2.1 time: 0.162749 Aug 09 07:08:34.003027 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 382/761] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:08:33 2022] GET /compute/v2.1/servers/f4e76bb7-6a13-4dbf-9062-4ba30c528398 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:08:34.460926 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-399f65a5-ab8c-4476-8e7e-d83e2fc45f50 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:34.461573 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-399f65a5-ab8c-4476-8e7e-d83e2fc45f50 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: e7e5215b-7f52-4485-9995-10958c4c3006] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:34.468637 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-399f65a5-ab8c-4476-8e7e-d83e2fc45f50 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:34.469752 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-399f65a5-ab8c-4476-8e7e-d83e2fc45f50 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:34.469752 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-399f65a5-ab8c-4476-8e7e-d83e2fc45f50 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:34.470244 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-399f65a5-ab8c-4476-8e7e-d83e2fc45f50 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:34.470699 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-399f65a5-ab8c-4476-8e7e-d83e2fc45f50 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:34.471121 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-399f65a5-ab8c-4476-8e7e-d83e2fc45f50 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:34.603894 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-399f65a5-ab8c-4476-8e7e-d83e2fc45f50 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:34.612094 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-399f65a5-ab8c-4476-8e7e-d83e2fc45f50 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006" status: 200 len: 1673 microversion: 2.1 time: 0.155012 Aug 09 07:08:34.612749 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 380/762] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:08:34 2022] GET /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006 => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:08:35.022704 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-8859347c-30c5-438e-88ff-97ecf394790c tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:35.023309 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-8859347c-30c5-438e-88ff-97ecf394790c tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: f4e76bb7-6a13-4dbf-9062-4ba30c528398] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:35.030262 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8859347c-30c5-438e-88ff-97ecf394790c tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:35.030747 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8859347c-30c5-438e-88ff-97ecf394790c tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:35.031179 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8859347c-30c5-438e-88ff-97ecf394790c tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:35.031889 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8859347c-30c5-438e-88ff-97ecf394790c tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:35.032346 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8859347c-30c5-438e-88ff-97ecf394790c tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:35.032792 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8859347c-30c5-438e-88ff-97ecf394790c tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:35.170626 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8859347c-30c5-438e-88ff-97ecf394790c tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:35.178734 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-8859347c-30c5-438e-88ff-97ecf394790c tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/f4e76bb7-6a13-4dbf-9062-4ba30c528398" status: 200 len: 1682 microversion: 2.1 time: 0.159753 Aug 09 07:08:35.179341 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 383/763] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:08:35 2022] GET /compute/v2.1/servers/f4e76bb7-6a13-4dbf-9062-4ba30c528398 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:08:35.636524 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-345ead9c-9d72-4107-8207-8c4ec822834e tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:35.637371 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-345ead9c-9d72-4107-8207-8c4ec822834e tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: e7e5215b-7f52-4485-9995-10958c4c3006] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:35.643850 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-345ead9c-9d72-4107-8207-8c4ec822834e tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:35.644341 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-345ead9c-9d72-4107-8207-8c4ec822834e tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:35.644778 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-345ead9c-9d72-4107-8207-8c4ec822834e tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:35.645480 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-345ead9c-9d72-4107-8207-8c4ec822834e tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:35.645929 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-345ead9c-9d72-4107-8207-8c4ec822834e tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:35.646355 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-345ead9c-9d72-4107-8207-8c4ec822834e tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:35.778214 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-345ead9c-9d72-4107-8207-8c4ec822834e tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:35.785946 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-345ead9c-9d72-4107-8207-8c4ec822834e tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006" status: 200 len: 1673 microversion: 2.1 time: 0.155225 Aug 09 07:08:35.786526 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 381/764] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:08:35 2022] GET /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006 => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:08:36.200300 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-636838b5-811c-4d36-ad0a-8387f5801726 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:36.200910 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-636838b5-811c-4d36-ad0a-8387f5801726 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: f4e76bb7-6a13-4dbf-9062-4ba30c528398] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:36.207530 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-636838b5-811c-4d36-ad0a-8387f5801726 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:36.208003 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-636838b5-811c-4d36-ad0a-8387f5801726 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:36.208637 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-636838b5-811c-4d36-ad0a-8387f5801726 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:36.209365 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-636838b5-811c-4d36-ad0a-8387f5801726 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:36.209821 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-636838b5-811c-4d36-ad0a-8387f5801726 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:36.210243 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-636838b5-811c-4d36-ad0a-8387f5801726 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:36.344224 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-636838b5-811c-4d36-ad0a-8387f5801726 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:36.351870 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-636838b5-811c-4d36-ad0a-8387f5801726 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/f4e76bb7-6a13-4dbf-9062-4ba30c528398" status: 200 len: 1682 microversion: 2.1 time: 0.155484 Aug 09 07:08:36.352437 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 384/765] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:08:36 2022] GET /compute/v2.1/servers/f4e76bb7-6a13-4dbf-9062-4ba30c528398 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:08:36.809751 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-70e50237-8f36-40ed-8d38-9eed300bcb7b tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:36.811047 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-70e50237-8f36-40ed-8d38-9eed300bcb7b tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: e7e5215b-7f52-4485-9995-10958c4c3006] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:36.817757 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-70e50237-8f36-40ed-8d38-9eed300bcb7b tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:36.818476 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-70e50237-8f36-40ed-8d38-9eed300bcb7b tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:36.819019 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-70e50237-8f36-40ed-8d38-9eed300bcb7b tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:36.819954 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-70e50237-8f36-40ed-8d38-9eed300bcb7b tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:36.820591 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-70e50237-8f36-40ed-8d38-9eed300bcb7b tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:36.821021 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-70e50237-8f36-40ed-8d38-9eed300bcb7b tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:36.898887 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-70e50237-8f36-40ed-8d38-9eed300bcb7b tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e528f53a4b94e0fab0d90e0dbe07216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7ada2fd6ffa44df9345c13afb650496', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:36.910900 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-70e50237-8f36-40ed-8d38-9eed300bcb7b tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006" status: 200 len: 1605 microversion: 2.1 time: 0.105637 Aug 09 07:08:36.911496 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 382/766] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:08:36 2022] GET /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006 => generated 1605 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:08:37.223255 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-3b6dcb46-06ca-4b0e-ab35-5abbdc470624 req-409ec770-c0fe-42da-9f5c-8bf82edd2588 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7e5215b-7f52-4485-9995-10958c4c3006", "name": "network-vif-deleted", "tag": "c73267b0-26d4-4dbf-9245-98ec45d37c2c"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:08:37.237740 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-3b6dcb46-06ca-4b0e-ab35-5abbdc470624 req-409ec770-c0fe-42da-9f5c-8bf82edd2588 service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:37.238148 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-3b6dcb46-06ca-4b0e-ab35-5abbdc470624 req-409ec770-c0fe-42da-9f5c-8bf82edd2588 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:37.238849 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-3b6dcb46-06ca-4b0e-ab35-5abbdc470624 req-409ec770-c0fe-42da-9f5c-8bf82edd2588 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:37.251223 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-3b6dcb46-06ca-4b0e-ab35-5abbdc470624 req-409ec770-c0fe-42da-9f5c-8bf82edd2588 service nova] Creating event network-vif-deleted:c73267b0-26d4-4dbf-9245-98ec45d37c2c for instance e7e5215b-7f52-4485-9995-10958c4c3006 on hv-cinder-85251 Aug 09 07:08:37.257695 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-3b6dcb46-06ca-4b0e-ab35-5abbdc470624 req-409ec770-c0fe-42da-9f5c-8bf82edd2588 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.218486 Aug 09 07:08:37.258303 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 385/767] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 07:08:37.377706 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-f6e936c0-3bce-46ae-b372-e1394921163d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:37.378482 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-f6e936c0-3bce-46ae-b372-e1394921163d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: f4e76bb7-6a13-4dbf-9062-4ba30c528398] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:37.384631 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f6e936c0-3bce-46ae-b372-e1394921163d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:37.385119 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f6e936c0-3bce-46ae-b372-e1394921163d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:37.386365 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f6e936c0-3bce-46ae-b372-e1394921163d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:37.387075 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f6e936c0-3bce-46ae-b372-e1394921163d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:37.387728 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f6e936c0-3bce-46ae-b372-e1394921163d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:37.388343 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f6e936c0-3bce-46ae-b372-e1394921163d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:37.429855 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f6e936c0-3bce-46ae-b372-e1394921163d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:37.430355 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f6e936c0-3bce-46ae-b372-e1394921163d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:37.430794 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f6e936c0-3bce-46ae-b372-e1394921163d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:37.431269 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.objects.instance [None req-f6e936c0-3bce-46ae-b372-e1394921163d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lazy-loading 'fault' on Instance uuid f4e76bb7-6a13-4dbf-9062-4ba30c528398 {{(pid=117858) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 07:08:37.477516 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-f6e936c0-3bce-46ae-b372-e1394921163d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc885026afe041cca086367bb67d8a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f38c6aa37b9643bbbe5bb7fd3efde4fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:37.485340 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-f6e936c0-3bce-46ae-b372-e1394921163d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/f4e76bb7-6a13-4dbf-9062-4ba30c528398" status: 200 len: 1331 microversion: 2.1 time: 0.111759 Aug 09 07:08:37.485909 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 383/768] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:08:37 2022] GET /compute/v2.1/servers/f4e76bb7-6a13-4dbf-9062-4ba30c528398 => generated 1331 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:08:37.935958 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-017759c0-4822-4c15-81e7-dae08c8fc2e6 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:37.936817 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-017759c0-4822-4c15-81e7-dae08c8fc2e6 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: e7e5215b-7f52-4485-9995-10958c4c3006] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:37.947515 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-017759c0-4822-4c15-81e7-dae08c8fc2e6 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:37.949254 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-017759c0-4822-4c15-81e7-dae08c8fc2e6 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:37.949919 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-017759c0-4822-4c15-81e7-dae08c8fc2e6 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:37.950785 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-017759c0-4822-4c15-81e7-dae08c8fc2e6 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:37.951397 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-017759c0-4822-4c15-81e7-dae08c8fc2e6 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:37.952037 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-017759c0-4822-4c15-81e7-dae08c8fc2e6 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:37.972955 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-017759c0-4822-4c15-81e7-dae08c8fc2e6 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] HTTP exception thrown: Instance e7e5215b-7f52-4485-9995-10958c4c3006 could not be found. Aug 09 07:08:37.974674 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-017759c0-4822-4c15-81e7-dae08c8fc2e6 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Request method failure captured: Aug 09 07:08:37.974674 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006 HTTP/1.1 Aug 09 07:08:37.974674 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 09 07:08:37.974674 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 09 07:08:37.974674 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Connection: close Aug 09 07:08:37.974674 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Length: 0 Aug 09 07:08:37.974674 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 09 07:08:37.974674 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.30 Aug 09 07:08:37.974674 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 09 07:08:37.974674 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.11 Aug 09 07:08:37.974674 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi8gaPh4UD8Lvsts7n6cRYQXvOuIgw_ZpKGOaLWJmiZbPPEZm6jRgu3O-sdtpcq3g5nszKTXfwzuDu4siciDBluQpQob3JvdcaWweC2dNTEsiNm9r1lDGUUVuvJmpQzcw40bAADmfJbAvFpmuPblEml6zt8swHKHYmVIOErwAWIvlwC_A Aug 09 07:08:37.974674 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 09 07:08:37.974674 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 09 07:08:37.974674 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 09 07:08:37.974674 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 09 07:08:37.974674 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 09 07:08:37.974674 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 09 07:08:37.974674 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Id: b7ada2fd6ffa44df9345c13afb650496 Aug 09 07:08:37.974674 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-AttachVolumeTestJSON-1520792079 Aug 09 07:08:37.974674 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 09 07:08:37.974674 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 09 07:08:37.976390 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b7ada2fd6ffa44df9345c13afb650496"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b7ada2fd6ffa44df9345c13afb650496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b7ada2fd6ffa44df9345c13afb650496"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b7ada2fd6ffa44df9345c13afb650496"}]}] Aug 09 07:08:37.976390 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-AttachVolumeTestJSON-1520792079 Aug 09 07:08:37.976390 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: b7ada2fd6ffa44df9345c13afb650496 Aug 09 07:08:37.976390 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1520792079 Aug 09 07:08:37.976390 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User: tempest-AttachVolumeTestJSON-1520792079-project Aug 09 07:08:37.976390 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 09 07:08:37.976390 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 09 07:08:37.976390 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Id: 4e528f53a4b94e0fab0d90e0dbe07216 Aug 09 07:08:37.976390 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-AttachVolumeTestJSON-1520792079-project Aug 09 07:08:37.976390 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: method: > Aug 09 07:08:37.976390 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: exception: Instance e7e5215b-7f52-4485-9995-10958c4c3006 could not be found. Aug 09 07:08:37.976390 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: action_args: {'id': 'e7e5215b-7f52-4485-9995-10958c4c3006'} Aug 09 07:08:37.981071 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 07:08:37.981071 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:08:37.981071 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 07:08:37.981071 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 07:08:37.981071 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 07:08:37.981071 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 07:08:37.981071 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 07:08:37.981071 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 07:08:37.981071 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 07:08:37.981071 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 07:08:37.981071 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7e5215b-7f52-4485-9995-10958c4c3006 could not be found. Aug 09 07:08:37.981071 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:08:37.981071 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:08:37.981071 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:08:37.981071 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:08:37.981071 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:08:37.981071 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:08:37.981071 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 07:08:37.981071 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 07:08:37.981071 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 07:08:37.982975 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 07:08:37.982975 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 07:08:37.982975 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 07:08:37.982975 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 07:08:37.982975 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 07:08:37.982975 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 07:08:37.982975 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 07:08:37.982975 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7e5215b-7f52-4485-9995-10958c4c3006 could not be found. Aug 09 07:08:37.982975 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:08:37.982975 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:08:37.982975 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:08:37.982975 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:08:37.982975 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:08:37.982975 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:08:37.982975 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 07:08:37.982975 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 07:08:37.982975 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7e5215b-7f52-4485-9995-10958c4c3006 could not be found. Aug 09 07:08:37.982975 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:08:37.984351 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-017759c0-4822-4c15-81e7-dae08c8fc2e6 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Returning 404 to user: Instance e7e5215b-7f52-4485-9995-10958c4c3006 could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 07:08:37.984351 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-017759c0-4822-4c15-81e7-dae08c8fc2e6 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006" status: 404 len: 111 microversion: 2.1 time: 0.046738 Aug 09 07:08:37.984351 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 386/769] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:08:37 2022] GET /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 07:08:37.989479 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-a7e8546e-bf8c-4dac-ba9e-1aa461aa8d48 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '.version_select at 0x7f20ddb195e0>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:38.017943 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-a7e8546e-bf8c-4dac-ba9e-1aa461aa8d48 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-235056689" status: 202 len: 0 microversion: 2.1 time: 0.032141 Aug 09 07:08:38.018518 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 384/770] 10.222.0.30 () {58 vars in 1218 bytes} [Tue Aug 9 07:08:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-235056689 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 07:08:38.507160 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-52deb8d0-198e-4fcc-8293-9b009bb40c9e tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:38.507823 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-52deb8d0-198e-4fcc-8293-9b009bb40c9e tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: f4e76bb7-6a13-4dbf-9062-4ba30c528398] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:38.531775 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-52deb8d0-198e-4fcc-8293-9b009bb40c9e tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:38.533150 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-52deb8d0-198e-4fcc-8293-9b009bb40c9e tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:38.538500 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-52deb8d0-198e-4fcc-8293-9b009bb40c9e tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:38.539267 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-52deb8d0-198e-4fcc-8293-9b009bb40c9e tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:38.539788 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-52deb8d0-198e-4fcc-8293-9b009bb40c9e tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:38.540222 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-52deb8d0-198e-4fcc-8293-9b009bb40c9e tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:38.556392 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-52deb8d0-198e-4fcc-8293-9b009bb40c9e tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] HTTP exception thrown: Instance f4e76bb7-6a13-4dbf-9062-4ba30c528398 could not be found. Aug 09 07:08:38.558414 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-52deb8d0-198e-4fcc-8293-9b009bb40c9e tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Request method failure captured: Aug 09 07:08:38.558414 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/f4e76bb7-6a13-4dbf-9062-4ba30c528398 HTTP/1.1 Aug 09 07:08:38.558414 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 09 07:08:38.558414 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 09 07:08:38.558414 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Connection: close Aug 09 07:08:38.558414 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Length: 0 Aug 09 07:08:38.558414 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 09 07:08:38.558414 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.30 Aug 09 07:08:38.558414 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 09 07:08:38.558414 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.11 Aug 09 07:08:38.558414 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi8gaG96fR8jlKQ8TiHSUILZSO2wcQMYr69tPNs3VsPdBbduE5q2N89Qfor1fKdUNuu3cU5AkFy4zL1QPl7jYp6fw9XYg8hg0IW6MscBdP4L-HtUgUgXdSQOw3p3as0Mug0wzwISkStMEUz2JvWC4HKwrWVHwt0TNvR0CveB6NheFq7RI Aug 09 07:08:38.558414 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 09 07:08:38.558414 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 09 07:08:38.558414 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 09 07:08:38.558414 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 09 07:08:38.558414 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 09 07:08:38.558414 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 09 07:08:38.558414 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Id: f38c6aa37b9643bbbe5bb7fd3efde4fd Aug 09 07:08:38.558414 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-AttachVolumeNegativeTest-2082484098 Aug 09 07:08:38.558414 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 09 07:08:38.558414 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 09 07:08:38.560106 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f38c6aa37b9643bbbe5bb7fd3efde4fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f38c6aa37b9643bbbe5bb7fd3efde4fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f38c6aa37b9643bbbe5bb7fd3efde4fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f38c6aa37b9643bbbe5bb7fd3efde4fd"}]}] Aug 09 07:08:38.560106 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-AttachVolumeNegativeTest-2082484098 Aug 09 07:08:38.560106 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: f38c6aa37b9643bbbe5bb7fd3efde4fd Aug 09 07:08:38.560106 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2082484098 Aug 09 07:08:38.560106 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User: tempest-AttachVolumeNegativeTest-2082484098-project Aug 09 07:08:38.560106 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 09 07:08:38.560106 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 09 07:08:38.560106 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Id: cc885026afe041cca086367bb67d8a9b Aug 09 07:08:38.560106 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-AttachVolumeNegativeTest-2082484098-project Aug 09 07:08:38.560106 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: method: > Aug 09 07:08:38.560106 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: exception: Instance f4e76bb7-6a13-4dbf-9062-4ba30c528398 could not be found. Aug 09 07:08:38.560106 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: action_args: {'id': 'f4e76bb7-6a13-4dbf-9062-4ba30c528398'} Aug 09 07:08:38.561550 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 07:08:38.561550 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:08:38.561550 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 07:08:38.561550 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 07:08:38.561550 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 07:08:38.561550 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 07:08:38.561550 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 07:08:38.561550 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 07:08:38.561550 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 07:08:38.561550 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 07:08:38.561550 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4e76bb7-6a13-4dbf-9062-4ba30c528398 could not be found. Aug 09 07:08:38.561550 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:08:38.561550 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:08:38.561550 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:08:38.561550 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:08:38.561550 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:08:38.561550 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:08:38.561550 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 07:08:38.561550 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 07:08:38.561550 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 07:08:38.563019 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 07:08:38.563019 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 07:08:38.563019 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 07:08:38.563019 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 07:08:38.563019 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 07:08:38.563019 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 07:08:38.563019 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 07:08:38.563019 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4e76bb7-6a13-4dbf-9062-4ba30c528398 could not be found. Aug 09 07:08:38.563019 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:08:38.563019 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:08:38.563019 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:08:38.563019 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:08:38.563019 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:08:38.563019 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:08:38.563019 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 07:08:38.563019 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 07:08:38.563019 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4e76bb7-6a13-4dbf-9062-4ba30c528398 could not be found. Aug 09 07:08:38.563019 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:08:38.565280 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-52deb8d0-198e-4fcc-8293-9b009bb40c9e tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Returning 404 to user: Instance f4e76bb7-6a13-4dbf-9062-4ba30c528398 could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 07:08:38.566314 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-52deb8d0-198e-4fcc-8293-9b009bb40c9e tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/f4e76bb7-6a13-4dbf-9062-4ba30c528398" status: 404 len: 111 microversion: 2.1 time: 0.063930 Aug 09 07:08:38.566881 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 387/771] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:08:38 2022] GET /compute/v2.1/servers/f4e76bb7-6a13-4dbf-9062-4ba30c528398 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 07:08:38.576147 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-7f3d57be-99b1-4b5d-a425-11fb7f196fa8 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '.version_select at 0x7f20ddc061f0>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:38.601426 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-7f3d57be-99b1-4b5d-a425-11fb7f196fa8 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-639039505" status: 202 len: 0 microversion: 2.1 time: 0.029477 Aug 09 07:08:38.602459 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 385/772] 10.222.0.30 () {58 vars in 1218 bytes} [Tue Aug 9 07:08:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-639039505 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 07:08:39.274097 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-3ca89694-b350-409b-ae8d-dc2589ba1ea1 req-fbee0ac3-945d-4655-9917-b66eea4472f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4e76bb7-6a13-4dbf-9062-4ba30c528398", "name": "network-vif-deleted", "tag": "176dfb6a-51a9-4f42-b980-38af9830240a"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:08:39.283487 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-3ca89694-b350-409b-ae8d-dc2589ba1ea1 req-fbee0ac3-945d-4655-9917-b66eea4472f9 service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:39.283997 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-3ca89694-b350-409b-ae8d-dc2589ba1ea1 req-fbee0ac3-945d-4655-9917-b66eea4472f9 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:39.284415 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-3ca89694-b350-409b-ae8d-dc2589ba1ea1 req-fbee0ac3-945d-4655-9917-b66eea4472f9 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:39.295657 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-3ca89694-b350-409b-ae8d-dc2589ba1ea1 req-fbee0ac3-945d-4655-9917-b66eea4472f9 service nova] Creating event network-vif-deleted:176dfb6a-51a9-4f42-b980-38af9830240a for instance f4e76bb7-6a13-4dbf-9062-4ba30c528398 on hv-cinder-85251 Aug 09 07:08:39.300515 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-3ca89694-b350-409b-ae8d-dc2589ba1ea1 req-fbee0ac3-945d-4655-9917-b66eea4472f9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030006 Aug 09 07:08:39.301701 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 388/773] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:08:40.458711 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-2dc5b823-56c6-45eb-9e78-7ad69495e635 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:40.459213 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-2dc5b823-56c6-45eb-9e78-7ad69495e635 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: f4e76bb7-6a13-4dbf-9062-4ba30c528398] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:40.466216 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2dc5b823-56c6-45eb-9e78-7ad69495e635 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:40.466702 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2dc5b823-56c6-45eb-9e78-7ad69495e635 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:40.467142 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2dc5b823-56c6-45eb-9e78-7ad69495e635 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:40.468005 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2dc5b823-56c6-45eb-9e78-7ad69495e635 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:40.468318 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2dc5b823-56c6-45eb-9e78-7ad69495e635 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:40.468743 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2dc5b823-56c6-45eb-9e78-7ad69495e635 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:40.481906 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.wsgi [None req-2dc5b823-56c6-45eb-9e78-7ad69495e635 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] HTTP exception thrown: Instance f4e76bb7-6a13-4dbf-9062-4ba30c528398 could not be found. Aug 09 07:08:40.483463 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-2dc5b823-56c6-45eb-9e78-7ad69495e635 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Request method failure captured: Aug 09 07:08:40.483463 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: request: DELETE /compute/v2.1/servers/f4e76bb7-6a13-4dbf-9062-4ba30c528398 HTTP/1.1 Aug 09 07:08:40.483463 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Accept: application/json Aug 09 07:08:40.483463 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Accept-Encoding: identity Aug 09 07:08:40.483463 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Connection: close Aug 09 07:08:40.483463 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Content-Length: 0 Aug 09 07:08:40.483463 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Content-Type: application/json Aug 09 07:08:40.483463 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Host: 10.222.0.30 Aug 09 07:08:40.483463 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Openstack-System-Scope: None Aug 09 07:08:40.483463 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: User-Agent: python-urllib3/1.26.11 Aug 09 07:08:40.483463 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Auth-Token: gAAAAABi8gaG96fR8jlKQ8TiHSUILZSO2wcQMYr69tPNs3VsPdBbduE5q2N89Qfor1fKdUNuu3cU5AkFy4zL1QPl7jYp6fw9XYg8hg0IW6MscBdP4L-HtUgUgXdSQOw3p3as0Mug0wzwISkStMEUz2JvWC4HKwrWVHwt0TNvR0CveB6NheFq7RI Aug 09 07:08:40.483463 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Domain-Id: None Aug 09 07:08:40.483463 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Domain-Name: None Aug 09 07:08:40.483463 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Identity-Status: Confirmed Aug 09 07:08:40.483463 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Is-Admin-Project: True Aug 09 07:08:40.483463 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Domain-Id: default Aug 09 07:08:40.483463 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Domain-Name: Default Aug 09 07:08:40.483463 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Id: f38c6aa37b9643bbbe5bb7fd3efde4fd Aug 09 07:08:40.483463 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Name: tempest-AttachVolumeNegativeTest-2082484098 Aug 09 07:08:40.483463 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Role: reader,member Aug 09 07:08:40.483463 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Roles: reader,member Aug 09 07:08:40.485049 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f38c6aa37b9643bbbe5bb7fd3efde4fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f38c6aa37b9643bbbe5bb7fd3efde4fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f38c6aa37b9643bbbe5bb7fd3efde4fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f38c6aa37b9643bbbe5bb7fd3efde4fd"}]}] Aug 09 07:08:40.485049 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant: tempest-AttachVolumeNegativeTest-2082484098 Aug 09 07:08:40.485049 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant-Id: f38c6aa37b9643bbbe5bb7fd3efde4fd Aug 09 07:08:40.485049 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2082484098 Aug 09 07:08:40.485049 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User: tempest-AttachVolumeNegativeTest-2082484098-project Aug 09 07:08:40.485049 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Domain-Id: default Aug 09 07:08:40.485049 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Domain-Name: Default Aug 09 07:08:40.485049 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Id: cc885026afe041cca086367bb67d8a9b Aug 09 07:08:40.485049 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Name: tempest-AttachVolumeNegativeTest-2082484098-project Aug 09 07:08:40.485049 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: method: > Aug 09 07:08:40.485049 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: exception: Instance f4e76bb7-6a13-4dbf-9062-4ba30c528398 could not be found. Aug 09 07:08:40.485049 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: action_args: {'id': 'f4e76bb7-6a13-4dbf-9062-4ba30c528398'} Aug 09 07:08:40.485979 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 07:08:40.485979 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:08:40.485979 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 07:08:40.485979 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 07:08:40.485979 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 07:08:40.485979 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 07:08:40.485979 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 07:08:40.485979 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 07:08:40.485979 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 07:08:40.485979 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 07:08:40.485979 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4e76bb7-6a13-4dbf-9062-4ba30c528398 could not be found. Aug 09 07:08:40.485979 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:08:40.485979 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:08:40.485979 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:08:40.485979 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:08:40.485979 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:08:40.485979 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:08:40.485979 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 07:08:40.485979 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 07:08:40.485979 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 07:08:40.487456 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 07:08:40.487456 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 07:08:40.487456 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 07:08:40.487456 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 07:08:40.487456 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 07:08:40.487456 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 07:08:40.487456 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 07:08:40.487456 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 07:08:40.487456 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 07:08:40.487456 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4e76bb7-6a13-4dbf-9062-4ba30c528398 could not be found. Aug 09 07:08:40.487456 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:08:40.487456 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:08:40.487456 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:08:40.487456 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:08:40.487456 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:08:40.487456 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:08:40.487456 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 07:08:40.487456 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 07:08:40.487456 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4e76bb7-6a13-4dbf-9062-4ba30c528398 could not be found. Aug 09 07:08:40.487456 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:08:40.489196 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-2dc5b823-56c6-45eb-9e78-7ad69495e635 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Returning 404 to user: Instance f4e76bb7-6a13-4dbf-9062-4ba30c528398 could not be found. {{(pid=117858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 07:08:40.489196 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-2dc5b823-56c6-45eb-9e78-7ad69495e635 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f4e76bb7-6a13-4dbf-9062-4ba30c528398" status: 404 len: 111 microversion: 2.1 time: 0.030002 Aug 09 07:08:40.489196 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 386/774] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 9 07:08:40 2022] DELETE /compute/v2.1/servers/f4e76bb7-6a13-4dbf-9062-4ba30c528398 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 07:08:40.494318 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c3f8e4ad-db5a-4d1f-a5e0-95aa52ef02af tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:40.495273 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c3f8e4ad-db5a-4d1f-a5e0-95aa52ef02af tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: f4e76bb7-6a13-4dbf-9062-4ba30c528398] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:40.501390 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c3f8e4ad-db5a-4d1f-a5e0-95aa52ef02af tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:40.501871 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c3f8e4ad-db5a-4d1f-a5e0-95aa52ef02af tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:40.502581 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c3f8e4ad-db5a-4d1f-a5e0-95aa52ef02af tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:40.503271 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c3f8e4ad-db5a-4d1f-a5e0-95aa52ef02af tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:40.503750 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c3f8e4ad-db5a-4d1f-a5e0-95aa52ef02af tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:40.504179 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c3f8e4ad-db5a-4d1f-a5e0-95aa52ef02af tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:40.517588 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-c3f8e4ad-db5a-4d1f-a5e0-95aa52ef02af tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] HTTP exception thrown: Instance f4e76bb7-6a13-4dbf-9062-4ba30c528398 could not be found. Aug 09 07:08:40.519162 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c3f8e4ad-db5a-4d1f-a5e0-95aa52ef02af tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Request method failure captured: Aug 09 07:08:40.519162 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/f4e76bb7-6a13-4dbf-9062-4ba30c528398 HTTP/1.1 Aug 09 07:08:40.519162 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 09 07:08:40.519162 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 09 07:08:40.519162 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Connection: close Aug 09 07:08:40.519162 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Length: 0 Aug 09 07:08:40.519162 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 09 07:08:40.519162 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.30 Aug 09 07:08:40.519162 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 09 07:08:40.519162 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.11 Aug 09 07:08:40.519162 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi8gaG96fR8jlKQ8TiHSUILZSO2wcQMYr69tPNs3VsPdBbduE5q2N89Qfor1fKdUNuu3cU5AkFy4zL1QPl7jYp6fw9XYg8hg0IW6MscBdP4L-HtUgUgXdSQOw3p3as0Mug0wzwISkStMEUz2JvWC4HKwrWVHwt0TNvR0CveB6NheFq7RI Aug 09 07:08:40.519162 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 09 07:08:40.519162 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 09 07:08:40.519162 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 09 07:08:40.519162 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 09 07:08:40.519162 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 09 07:08:40.519162 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 09 07:08:40.519162 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Id: f38c6aa37b9643bbbe5bb7fd3efde4fd Aug 09 07:08:40.519162 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-AttachVolumeNegativeTest-2082484098 Aug 09 07:08:40.519162 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 09 07:08:40.519162 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 09 07:08:40.520713 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f38c6aa37b9643bbbe5bb7fd3efde4fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f38c6aa37b9643bbbe5bb7fd3efde4fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f38c6aa37b9643bbbe5bb7fd3efde4fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f38c6aa37b9643bbbe5bb7fd3efde4fd"}]}] Aug 09 07:08:40.520713 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-AttachVolumeNegativeTest-2082484098 Aug 09 07:08:40.520713 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: f38c6aa37b9643bbbe5bb7fd3efde4fd Aug 09 07:08:40.520713 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2082484098 Aug 09 07:08:40.520713 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User: tempest-AttachVolumeNegativeTest-2082484098-project Aug 09 07:08:40.520713 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 09 07:08:40.520713 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 09 07:08:40.520713 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Id: cc885026afe041cca086367bb67d8a9b Aug 09 07:08:40.520713 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-AttachVolumeNegativeTest-2082484098-project Aug 09 07:08:40.520713 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: method: > Aug 09 07:08:40.520713 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: exception: Instance f4e76bb7-6a13-4dbf-9062-4ba30c528398 could not be found. Aug 09 07:08:40.520713 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: action_args: {'id': 'f4e76bb7-6a13-4dbf-9062-4ba30c528398'} Aug 09 07:08:40.521564 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 07:08:40.521564 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:08:40.521564 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 07:08:40.521564 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 07:08:40.521564 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 07:08:40.521564 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 07:08:40.521564 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 07:08:40.521564 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 07:08:40.521564 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 07:08:40.521564 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 07:08:40.521564 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4e76bb7-6a13-4dbf-9062-4ba30c528398 could not be found. Aug 09 07:08:40.521564 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:08:40.521564 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:08:40.521564 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:08:40.521564 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:08:40.521564 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:08:40.521564 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:08:40.521564 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 07:08:40.521564 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 07:08:40.521564 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 07:08:40.523006 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 07:08:40.523006 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 07:08:40.523006 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 07:08:40.523006 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 07:08:40.523006 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 07:08:40.523006 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 07:08:40.523006 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 07:08:40.523006 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4e76bb7-6a13-4dbf-9062-4ba30c528398 could not be found. Aug 09 07:08:40.523006 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:08:40.523006 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:08:40.523006 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:08:40.523006 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:08:40.523006 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:08:40.523006 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:08:40.523006 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 07:08:40.523006 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 07:08:40.523006 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4e76bb7-6a13-4dbf-9062-4ba30c528398 could not be found. Aug 09 07:08:40.523006 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:08:40.524379 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c3f8e4ad-db5a-4d1f-a5e0-95aa52ef02af tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Returning 404 to user: Instance f4e76bb7-6a13-4dbf-9062-4ba30c528398 could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 07:08:40.524379 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c3f8e4ad-db5a-4d1f-a5e0-95aa52ef02af tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/f4e76bb7-6a13-4dbf-9062-4ba30c528398" status: 404 len: 111 microversion: 2.1 time: 0.030939 Aug 09 07:08:40.524379 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 389/775] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:08:40 2022] GET /compute/v2.1/servers/f4e76bb7-6a13-4dbf-9062-4ba30c528398 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 07:08:41.087458 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-e8e8f8a7-065b-41ef-a71b-9760ed7b6d9b tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:41.088285 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-e8e8f8a7-065b-41ef-a71b-9760ed7b6d9b tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: e7e5215b-7f52-4485-9995-10958c4c3006] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:41.098090 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e8e8f8a7-065b-41ef-a71b-9760ed7b6d9b tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:41.098790 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e8e8f8a7-065b-41ef-a71b-9760ed7b6d9b tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:41.099496 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e8e8f8a7-065b-41ef-a71b-9760ed7b6d9b tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:41.100568 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e8e8f8a7-065b-41ef-a71b-9760ed7b6d9b tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:41.101123 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e8e8f8a7-065b-41ef-a71b-9760ed7b6d9b tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:41.101642 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e8e8f8a7-065b-41ef-a71b-9760ed7b6d9b tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:41.116425 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.wsgi [None req-e8e8f8a7-065b-41ef-a71b-9760ed7b6d9b tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] HTTP exception thrown: Instance e7e5215b-7f52-4485-9995-10958c4c3006 could not be found. Aug 09 07:08:41.118051 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-e8e8f8a7-065b-41ef-a71b-9760ed7b6d9b tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Request method failure captured: Aug 09 07:08:41.118051 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: request: DELETE /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006 HTTP/1.1 Aug 09 07:08:41.118051 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Accept: application/json Aug 09 07:08:41.118051 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Accept-Encoding: identity Aug 09 07:08:41.118051 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Connection: close Aug 09 07:08:41.118051 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Content-Length: 0 Aug 09 07:08:41.118051 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Content-Type: application/json Aug 09 07:08:41.118051 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Host: 10.222.0.30 Aug 09 07:08:41.118051 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Openstack-System-Scope: None Aug 09 07:08:41.118051 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: User-Agent: python-urllib3/1.26.11 Aug 09 07:08:41.118051 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Auth-Token: gAAAAABi8gaPh4UD8Lvsts7n6cRYQXvOuIgw_ZpKGOaLWJmiZbPPEZm6jRgu3O-sdtpcq3g5nszKTXfwzuDu4siciDBluQpQob3JvdcaWweC2dNTEsiNm9r1lDGUUVuvJmpQzcw40bAADmfJbAvFpmuPblEml6zt8swHKHYmVIOErwAWIvlwC_A Aug 09 07:08:41.118051 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Domain-Id: None Aug 09 07:08:41.118051 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Domain-Name: None Aug 09 07:08:41.118051 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Identity-Status: Confirmed Aug 09 07:08:41.118051 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Is-Admin-Project: True Aug 09 07:08:41.118051 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Domain-Id: default Aug 09 07:08:41.118051 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Domain-Name: Default Aug 09 07:08:41.118051 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Id: b7ada2fd6ffa44df9345c13afb650496 Aug 09 07:08:41.118051 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Name: tempest-AttachVolumeTestJSON-1520792079 Aug 09 07:08:41.118051 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Role: reader,member Aug 09 07:08:41.118051 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Roles: reader,member Aug 09 07:08:41.119449 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b7ada2fd6ffa44df9345c13afb650496"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b7ada2fd6ffa44df9345c13afb650496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b7ada2fd6ffa44df9345c13afb650496"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b7ada2fd6ffa44df9345c13afb650496"}]}] Aug 09 07:08:41.119449 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant: tempest-AttachVolumeTestJSON-1520792079 Aug 09 07:08:41.119449 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant-Id: b7ada2fd6ffa44df9345c13afb650496 Aug 09 07:08:41.119449 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1520792079 Aug 09 07:08:41.119449 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User: tempest-AttachVolumeTestJSON-1520792079-project Aug 09 07:08:41.119449 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Domain-Id: default Aug 09 07:08:41.119449 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Domain-Name: Default Aug 09 07:08:41.119449 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Id: 4e528f53a4b94e0fab0d90e0dbe07216 Aug 09 07:08:41.119449 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Name: tempest-AttachVolumeTestJSON-1520792079-project Aug 09 07:08:41.119449 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: method: > Aug 09 07:08:41.119449 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: exception: Instance e7e5215b-7f52-4485-9995-10958c4c3006 could not be found. Aug 09 07:08:41.119449 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: action_args: {'id': 'e7e5215b-7f52-4485-9995-10958c4c3006'} Aug 09 07:08:41.120923 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 07:08:41.120923 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:08:41.120923 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 07:08:41.120923 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 07:08:41.120923 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 07:08:41.120923 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 07:08:41.120923 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 07:08:41.120923 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 07:08:41.120923 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 07:08:41.120923 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 07:08:41.120923 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7e5215b-7f52-4485-9995-10958c4c3006 could not be found. Aug 09 07:08:41.120923 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:08:41.120923 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:08:41.120923 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:08:41.120923 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:08:41.120923 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:08:41.120923 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:08:41.120923 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 07:08:41.120923 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 07:08:41.120923 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 07:08:41.122090 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 07:08:41.122090 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 07:08:41.122090 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 07:08:41.122090 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 07:08:41.122090 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 07:08:41.122090 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 07:08:41.122090 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 07:08:41.122090 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 07:08:41.122090 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 07:08:41.122090 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7e5215b-7f52-4485-9995-10958c4c3006 could not be found. Aug 09 07:08:41.122090 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:08:41.122090 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:08:41.122090 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:08:41.122090 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:08:41.122090 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:08:41.122090 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:08:41.122090 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 07:08:41.122090 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 07:08:41.122090 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7e5215b-7f52-4485-9995-10958c4c3006 could not be found. Aug 09 07:08:41.122090 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:08:41.123261 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-e8e8f8a7-065b-41ef-a71b-9760ed7b6d9b tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Returning 404 to user: Instance e7e5215b-7f52-4485-9995-10958c4c3006 could not be found. {{(pid=117858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 07:08:41.123261 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-e8e8f8a7-065b-41ef-a71b-9760ed7b6d9b tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "DELETE /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006" status: 404 len: 111 microversion: 2.1 time: 0.038188 Aug 09 07:08:41.123261 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 387/776] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 9 07:08:41 2022] DELETE /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 07:08:41.129231 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b9aa677f-80c9-418c-96df-231848caf6fa tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:41.129841 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b9aa677f-80c9-418c-96df-231848caf6fa tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: e7e5215b-7f52-4485-9995-10958c4c3006] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:41.136541 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b9aa677f-80c9-418c-96df-231848caf6fa tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:41.137024 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b9aa677f-80c9-418c-96df-231848caf6fa tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:41.137458 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b9aa677f-80c9-418c-96df-231848caf6fa tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:41.138159 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b9aa677f-80c9-418c-96df-231848caf6fa tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:41.138613 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b9aa677f-80c9-418c-96df-231848caf6fa tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:41.139096 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b9aa677f-80c9-418c-96df-231848caf6fa tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:41.152701 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-b9aa677f-80c9-418c-96df-231848caf6fa tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] HTTP exception thrown: Instance e7e5215b-7f52-4485-9995-10958c4c3006 could not be found. Aug 09 07:08:41.155006 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b9aa677f-80c9-418c-96df-231848caf6fa tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Request method failure captured: Aug 09 07:08:41.155006 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006 HTTP/1.1 Aug 09 07:08:41.155006 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 09 07:08:41.155006 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 09 07:08:41.155006 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Connection: close Aug 09 07:08:41.155006 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Length: 0 Aug 09 07:08:41.155006 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 09 07:08:41.155006 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.30 Aug 09 07:08:41.155006 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 09 07:08:41.155006 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.11 Aug 09 07:08:41.155006 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi8gaPh4UD8Lvsts7n6cRYQXvOuIgw_ZpKGOaLWJmiZbPPEZm6jRgu3O-sdtpcq3g5nszKTXfwzuDu4siciDBluQpQob3JvdcaWweC2dNTEsiNm9r1lDGUUVuvJmpQzcw40bAADmfJbAvFpmuPblEml6zt8swHKHYmVIOErwAWIvlwC_A Aug 09 07:08:41.155006 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 09 07:08:41.155006 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 09 07:08:41.155006 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 09 07:08:41.155006 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 09 07:08:41.155006 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 09 07:08:41.155006 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 09 07:08:41.155006 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Id: b7ada2fd6ffa44df9345c13afb650496 Aug 09 07:08:41.155006 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-AttachVolumeTestJSON-1520792079 Aug 09 07:08:41.155006 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 09 07:08:41.155006 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 09 07:08:41.156613 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b7ada2fd6ffa44df9345c13afb650496"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b7ada2fd6ffa44df9345c13afb650496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b7ada2fd6ffa44df9345c13afb650496"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b7ada2fd6ffa44df9345c13afb650496"}]}] Aug 09 07:08:41.156613 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-AttachVolumeTestJSON-1520792079 Aug 09 07:08:41.156613 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: b7ada2fd6ffa44df9345c13afb650496 Aug 09 07:08:41.156613 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1520792079 Aug 09 07:08:41.156613 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User: tempest-AttachVolumeTestJSON-1520792079-project Aug 09 07:08:41.156613 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 09 07:08:41.156613 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 09 07:08:41.156613 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Id: 4e528f53a4b94e0fab0d90e0dbe07216 Aug 09 07:08:41.156613 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-AttachVolumeTestJSON-1520792079-project Aug 09 07:08:41.156613 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: method: > Aug 09 07:08:41.156613 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: exception: Instance e7e5215b-7f52-4485-9995-10958c4c3006 could not be found. Aug 09 07:08:41.156613 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: action_args: {'id': 'e7e5215b-7f52-4485-9995-10958c4c3006'} Aug 09 07:08:41.157429 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 07:08:41.157429 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:08:41.157429 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 07:08:41.157429 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 07:08:41.157429 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 07:08:41.157429 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 07:08:41.157429 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 07:08:41.157429 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 07:08:41.157429 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 07:08:41.157429 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 07:08:41.157429 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7e5215b-7f52-4485-9995-10958c4c3006 could not be found. Aug 09 07:08:41.157429 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:08:41.157429 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:08:41.157429 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:08:41.157429 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:08:41.157429 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:08:41.157429 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:08:41.157429 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 07:08:41.157429 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 07:08:41.157429 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 07:08:41.158825 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 07:08:41.158825 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 07:08:41.158825 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 07:08:41.158825 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 07:08:41.158825 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 07:08:41.158825 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 07:08:41.158825 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 07:08:41.158825 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7e5215b-7f52-4485-9995-10958c4c3006 could not be found. Aug 09 07:08:41.158825 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:08:41.158825 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:08:41.158825 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:08:41.158825 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:08:41.158825 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:08:41.158825 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:08:41.158825 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 07:08:41.158825 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 07:08:41.158825 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7e5215b-7f52-4485-9995-10958c4c3006 could not be found. Aug 09 07:08:41.158825 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:08:41.160110 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b9aa677f-80c9-418c-96df-231848caf6fa tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Returning 404 to user: Instance e7e5215b-7f52-4485-9995-10958c4c3006 could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 07:08:41.160110 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b9aa677f-80c9-418c-96df-231848caf6fa tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006" status: 404 len: 111 microversion: 2.1 time: 0.031484 Aug 09 07:08:41.160110 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 390/777] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:08:41 2022] GET /compute/v2.1/servers/e7e5215b-7f52-4485-9995-10958c4c3006 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 07:08:41.662783 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-c1f75a35-7e65-4bba-a325-22630b60c8f0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:41.663305 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-c1f75a35-7e65-4bba-a325-22630b60c8f0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: eb8f3b26-f937-4677-b8f9-9208f68a0449] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:41.669815 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c1f75a35-7e65-4bba-a325-22630b60c8f0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:41.670300 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c1f75a35-7e65-4bba-a325-22630b60c8f0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:41.670739 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c1f75a35-7e65-4bba-a325-22630b60c8f0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:41.671434 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c1f75a35-7e65-4bba-a325-22630b60c8f0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:41.671923 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c1f75a35-7e65-4bba-a325-22630b60c8f0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:41.673006 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c1f75a35-7e65-4bba-a325-22630b60c8f0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:41.687038 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.wsgi [None req-c1f75a35-7e65-4bba-a325-22630b60c8f0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] HTTP exception thrown: Instance eb8f3b26-f937-4677-b8f9-9208f68a0449 could not be found. Aug 09 07:08:41.688596 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-c1f75a35-7e65-4bba-a325-22630b60c8f0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Request method failure captured: Aug 09 07:08:41.688596 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: request: DELETE /compute/v2.1/servers/eb8f3b26-f937-4677-b8f9-9208f68a0449 HTTP/1.1 Aug 09 07:08:41.688596 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Accept: application/json Aug 09 07:08:41.688596 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Accept-Encoding: identity Aug 09 07:08:41.688596 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Connection: close Aug 09 07:08:41.688596 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Content-Length: 0 Aug 09 07:08:41.688596 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Content-Type: application/json Aug 09 07:08:41.688596 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Host: 10.222.0.30 Aug 09 07:08:41.688596 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Openstack-System-Scope: None Aug 09 07:08:41.688596 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: User-Agent: python-urllib3/1.26.11 Aug 09 07:08:41.688596 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Auth-Token: gAAAAABi8gaG96fR8jlKQ8TiHSUILZSO2wcQMYr69tPNs3VsPdBbduE5q2N89Qfor1fKdUNuu3cU5AkFy4zL1QPl7jYp6fw9XYg8hg0IW6MscBdP4L-HtUgUgXdSQOw3p3as0Mug0wzwISkStMEUz2JvWC4HKwrWVHwt0TNvR0CveB6NheFq7RI Aug 09 07:08:41.688596 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Domain-Id: None Aug 09 07:08:41.688596 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Domain-Name: None Aug 09 07:08:41.688596 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Identity-Status: Confirmed Aug 09 07:08:41.688596 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Is-Admin-Project: True Aug 09 07:08:41.688596 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Domain-Id: default Aug 09 07:08:41.688596 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Domain-Name: Default Aug 09 07:08:41.688596 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Id: f38c6aa37b9643bbbe5bb7fd3efde4fd Aug 09 07:08:41.688596 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Name: tempest-AttachVolumeNegativeTest-2082484098 Aug 09 07:08:41.688596 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Role: reader,member Aug 09 07:08:41.688596 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Roles: reader,member Aug 09 07:08:41.690137 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f38c6aa37b9643bbbe5bb7fd3efde4fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f38c6aa37b9643bbbe5bb7fd3efde4fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f38c6aa37b9643bbbe5bb7fd3efde4fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f38c6aa37b9643bbbe5bb7fd3efde4fd"}]}] Aug 09 07:08:41.690137 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant: tempest-AttachVolumeNegativeTest-2082484098 Aug 09 07:08:41.690137 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant-Id: f38c6aa37b9643bbbe5bb7fd3efde4fd Aug 09 07:08:41.690137 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2082484098 Aug 09 07:08:41.690137 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User: tempest-AttachVolumeNegativeTest-2082484098-project Aug 09 07:08:41.690137 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Domain-Id: default Aug 09 07:08:41.690137 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Domain-Name: Default Aug 09 07:08:41.690137 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Id: cc885026afe041cca086367bb67d8a9b Aug 09 07:08:41.690137 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Name: tempest-AttachVolumeNegativeTest-2082484098-project Aug 09 07:08:41.690137 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: method: > Aug 09 07:08:41.690137 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: exception: Instance eb8f3b26-f937-4677-b8f9-9208f68a0449 could not be found. Aug 09 07:08:41.690137 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: action_args: {'id': 'eb8f3b26-f937-4677-b8f9-9208f68a0449'} Aug 09 07:08:41.690999 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 07:08:41.690999 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:08:41.690999 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 07:08:41.690999 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 07:08:41.690999 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 07:08:41.690999 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 07:08:41.690999 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 07:08:41.690999 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 07:08:41.690999 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 07:08:41.690999 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 07:08:41.690999 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb8f3b26-f937-4677-b8f9-9208f68a0449 could not be found. Aug 09 07:08:41.690999 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:08:41.690999 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:08:41.690999 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:08:41.690999 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:08:41.690999 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:08:41.690999 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:08:41.690999 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 07:08:41.690999 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 07:08:41.690999 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 07:08:41.692338 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 07:08:41.692338 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 07:08:41.692338 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 07:08:41.692338 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 07:08:41.692338 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 07:08:41.692338 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 07:08:41.692338 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 07:08:41.692338 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 07:08:41.692338 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 07:08:41.692338 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb8f3b26-f937-4677-b8f9-9208f68a0449 could not be found. Aug 09 07:08:41.692338 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:08:41.692338 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:08:41.692338 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:08:41.692338 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:08:41.692338 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:08:41.692338 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:08:41.692338 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 07:08:41.692338 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 07:08:41.692338 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb8f3b26-f937-4677-b8f9-9208f68a0449 could not be found. Aug 09 07:08:41.692338 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:08:41.694004 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-c1f75a35-7e65-4bba-a325-22630b60c8f0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Returning 404 to user: Instance eb8f3b26-f937-4677-b8f9-9208f68a0449 could not be found. {{(pid=117858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 07:08:41.694004 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-c1f75a35-7e65-4bba-a325-22630b60c8f0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "DELETE /compute/v2.1/servers/eb8f3b26-f937-4677-b8f9-9208f68a0449" status: 404 len: 111 microversion: 2.1 time: 0.031069 Aug 09 07:08:41.694004 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 388/778] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 9 07:08:41 2022] DELETE /compute/v2.1/servers/eb8f3b26-f937-4677-b8f9-9208f68a0449 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 07:08:41.699343 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-3e0b860c-e66a-47d4-a28f-a4d180a55fd0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:41.700024 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-3e0b860c-e66a-47d4-a28f-a4d180a55fd0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: eb8f3b26-f937-4677-b8f9-9208f68a0449] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:41.706660 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3e0b860c-e66a-47d4-a28f-a4d180a55fd0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:41.707128 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3e0b860c-e66a-47d4-a28f-a4d180a55fd0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:41.707582 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3e0b860c-e66a-47d4-a28f-a4d180a55fd0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:41.708294 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3e0b860c-e66a-47d4-a28f-a4d180a55fd0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:41.708748 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3e0b860c-e66a-47d4-a28f-a4d180a55fd0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:41.709174 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3e0b860c-e66a-47d4-a28f-a4d180a55fd0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:41.722975 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-3e0b860c-e66a-47d4-a28f-a4d180a55fd0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] HTTP exception thrown: Instance eb8f3b26-f937-4677-b8f9-9208f68a0449 could not be found. Aug 09 07:08:41.724489 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-3e0b860c-e66a-47d4-a28f-a4d180a55fd0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Request method failure captured: Aug 09 07:08:41.724489 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/eb8f3b26-f937-4677-b8f9-9208f68a0449 HTTP/1.1 Aug 09 07:08:41.724489 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 09 07:08:41.724489 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 09 07:08:41.724489 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Connection: close Aug 09 07:08:41.724489 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Length: 0 Aug 09 07:08:41.724489 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 09 07:08:41.724489 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.30 Aug 09 07:08:41.724489 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 09 07:08:41.724489 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.11 Aug 09 07:08:41.724489 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi8gaG96fR8jlKQ8TiHSUILZSO2wcQMYr69tPNs3VsPdBbduE5q2N89Qfor1fKdUNuu3cU5AkFy4zL1QPl7jYp6fw9XYg8hg0IW6MscBdP4L-HtUgUgXdSQOw3p3as0Mug0wzwISkStMEUz2JvWC4HKwrWVHwt0TNvR0CveB6NheFq7RI Aug 09 07:08:41.724489 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 09 07:08:41.724489 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 09 07:08:41.724489 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 09 07:08:41.724489 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 09 07:08:41.724489 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 09 07:08:41.724489 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 09 07:08:41.724489 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Id: f38c6aa37b9643bbbe5bb7fd3efde4fd Aug 09 07:08:41.724489 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-AttachVolumeNegativeTest-2082484098 Aug 09 07:08:41.724489 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 09 07:08:41.724489 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 09 07:08:41.726014 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f38c6aa37b9643bbbe5bb7fd3efde4fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f38c6aa37b9643bbbe5bb7fd3efde4fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f38c6aa37b9643bbbe5bb7fd3efde4fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f38c6aa37b9643bbbe5bb7fd3efde4fd"}]}] Aug 09 07:08:41.726014 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-AttachVolumeNegativeTest-2082484098 Aug 09 07:08:41.726014 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: f38c6aa37b9643bbbe5bb7fd3efde4fd Aug 09 07:08:41.726014 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2082484098 Aug 09 07:08:41.726014 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User: tempest-AttachVolumeNegativeTest-2082484098-project Aug 09 07:08:41.726014 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 09 07:08:41.726014 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 09 07:08:41.726014 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Id: cc885026afe041cca086367bb67d8a9b Aug 09 07:08:41.726014 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-AttachVolumeNegativeTest-2082484098-project Aug 09 07:08:41.726014 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: method: > Aug 09 07:08:41.726014 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: exception: Instance eb8f3b26-f937-4677-b8f9-9208f68a0449 could not be found. Aug 09 07:08:41.726014 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: action_args: {'id': 'eb8f3b26-f937-4677-b8f9-9208f68a0449'} Aug 09 07:08:41.726847 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 07:08:41.726847 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:08:41.726847 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 07:08:41.726847 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 07:08:41.726847 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 07:08:41.726847 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 07:08:41.726847 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 07:08:41.726847 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 07:08:41.726847 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 07:08:41.726847 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 07:08:41.726847 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb8f3b26-f937-4677-b8f9-9208f68a0449 could not be found. Aug 09 07:08:41.726847 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:08:41.726847 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:08:41.726847 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:08:41.726847 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:08:41.726847 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:08:41.726847 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:08:41.726847 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 07:08:41.726847 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 07:08:41.726847 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 07:08:41.728747 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 07:08:41.728747 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 07:08:41.728747 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 07:08:41.728747 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 07:08:41.728747 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 07:08:41.728747 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 07:08:41.728747 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 07:08:41.728747 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb8f3b26-f937-4677-b8f9-9208f68a0449 could not be found. Aug 09 07:08:41.728747 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:08:41.728747 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:08:41.728747 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:08:41.728747 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:08:41.728747 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:08:41.728747 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:08:41.728747 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 07:08:41.728747 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 07:08:41.728747 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb8f3b26-f937-4677-b8f9-9208f68a0449 could not be found. Aug 09 07:08:41.728747 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:08:41.730111 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-3e0b860c-e66a-47d4-a28f-a4d180a55fd0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Returning 404 to user: Instance eb8f3b26-f937-4677-b8f9-9208f68a0449 could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 07:08:41.730111 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-3e0b860c-e66a-47d4-a28f-a4d180a55fd0 tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/eb8f3b26-f937-4677-b8f9-9208f68a0449" status: 404 len: 111 microversion: 2.1 time: 0.031358 Aug 09 07:08:41.730111 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 391/779] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:08:41 2022] GET /compute/v2.1/servers/eb8f3b26-f937-4677-b8f9-9208f68a0449 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 07:08:41.734585 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-6a574404-2a9e-4edb-9790-d4254b3daeca tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:41.735077 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-6a574404-2a9e-4edb-9790-d4254b3daeca tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: f5e9e5b3-58c6-44f2-940a-c72b15dfd8db] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:41.741447 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6a574404-2a9e-4edb-9790-d4254b3daeca tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:41.741932 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6a574404-2a9e-4edb-9790-d4254b3daeca tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:41.742369 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6a574404-2a9e-4edb-9790-d4254b3daeca tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:41.743060 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6a574404-2a9e-4edb-9790-d4254b3daeca tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:41.743512 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6a574404-2a9e-4edb-9790-d4254b3daeca tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:41.743982 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6a574404-2a9e-4edb-9790-d4254b3daeca tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:41.757890 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.wsgi [None req-6a574404-2a9e-4edb-9790-d4254b3daeca tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] HTTP exception thrown: Instance f5e9e5b3-58c6-44f2-940a-c72b15dfd8db could not be found. Aug 09 07:08:41.759397 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-6a574404-2a9e-4edb-9790-d4254b3daeca tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Request method failure captured: Aug 09 07:08:41.759397 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: request: DELETE /compute/v2.1/servers/f5e9e5b3-58c6-44f2-940a-c72b15dfd8db HTTP/1.1 Aug 09 07:08:41.759397 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Accept: application/json Aug 09 07:08:41.759397 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Accept-Encoding: identity Aug 09 07:08:41.759397 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Connection: close Aug 09 07:08:41.759397 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Content-Length: 0 Aug 09 07:08:41.759397 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Content-Type: application/json Aug 09 07:08:41.759397 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Host: 10.222.0.30 Aug 09 07:08:41.759397 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Openstack-System-Scope: None Aug 09 07:08:41.759397 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: User-Agent: python-urllib3/1.26.11 Aug 09 07:08:41.759397 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Auth-Token: gAAAAABi8gaG96fR8jlKQ8TiHSUILZSO2wcQMYr69tPNs3VsPdBbduE5q2N89Qfor1fKdUNuu3cU5AkFy4zL1QPl7jYp6fw9XYg8hg0IW6MscBdP4L-HtUgUgXdSQOw3p3as0Mug0wzwISkStMEUz2JvWC4HKwrWVHwt0TNvR0CveB6NheFq7RI Aug 09 07:08:41.759397 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Domain-Id: None Aug 09 07:08:41.759397 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Domain-Name: None Aug 09 07:08:41.759397 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Identity-Status: Confirmed Aug 09 07:08:41.759397 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Is-Admin-Project: True Aug 09 07:08:41.759397 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Domain-Id: default Aug 09 07:08:41.759397 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Domain-Name: Default Aug 09 07:08:41.759397 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Id: f38c6aa37b9643bbbe5bb7fd3efde4fd Aug 09 07:08:41.759397 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Name: tempest-AttachVolumeNegativeTest-2082484098 Aug 09 07:08:41.759397 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Role: reader,member Aug 09 07:08:41.759397 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Roles: reader,member Aug 09 07:08:41.761484 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f38c6aa37b9643bbbe5bb7fd3efde4fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f38c6aa37b9643bbbe5bb7fd3efde4fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f38c6aa37b9643bbbe5bb7fd3efde4fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f38c6aa37b9643bbbe5bb7fd3efde4fd"}]}] Aug 09 07:08:41.761484 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant: tempest-AttachVolumeNegativeTest-2082484098 Aug 09 07:08:41.761484 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant-Id: f38c6aa37b9643bbbe5bb7fd3efde4fd Aug 09 07:08:41.761484 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2082484098 Aug 09 07:08:41.761484 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User: tempest-AttachVolumeNegativeTest-2082484098-project Aug 09 07:08:41.761484 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Domain-Id: default Aug 09 07:08:41.761484 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Domain-Name: Default Aug 09 07:08:41.761484 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Id: cc885026afe041cca086367bb67d8a9b Aug 09 07:08:41.761484 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Name: tempest-AttachVolumeNegativeTest-2082484098-project Aug 09 07:08:41.761484 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: method: > Aug 09 07:08:41.761484 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: exception: Instance f5e9e5b3-58c6-44f2-940a-c72b15dfd8db could not be found. Aug 09 07:08:41.761484 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: action_args: {'id': 'f5e9e5b3-58c6-44f2-940a-c72b15dfd8db'} Aug 09 07:08:41.762419 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 07:08:41.762419 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:08:41.762419 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 07:08:41.762419 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 07:08:41.762419 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 07:08:41.762419 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 07:08:41.762419 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 07:08:41.762419 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 07:08:41.762419 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 07:08:41.762419 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 07:08:41.762419 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5e9e5b3-58c6-44f2-940a-c72b15dfd8db could not be found. Aug 09 07:08:41.762419 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:08:41.762419 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:08:41.762419 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:08:41.762419 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:08:41.762419 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:08:41.762419 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:08:41.762419 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 07:08:41.762419 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 07:08:41.762419 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 07:08:41.763947 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 07:08:41.763947 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 07:08:41.763947 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 07:08:41.763947 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 07:08:41.763947 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 07:08:41.763947 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 07:08:41.763947 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 07:08:41.763947 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 07:08:41.763947 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 07:08:41.763947 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5e9e5b3-58c6-44f2-940a-c72b15dfd8db could not be found. Aug 09 07:08:41.763947 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:08:41.763947 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:08:41.763947 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:08:41.763947 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:08:41.763947 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:08:41.763947 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:08:41.763947 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 07:08:41.763947 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 07:08:41.763947 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5e9e5b3-58c6-44f2-940a-c72b15dfd8db could not be found. Aug 09 07:08:41.763947 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:08:41.765805 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-6a574404-2a9e-4edb-9790-d4254b3daeca tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Returning 404 to user: Instance f5e9e5b3-58c6-44f2-940a-c72b15dfd8db could not be found. {{(pid=117858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 07:08:41.765805 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-6a574404-2a9e-4edb-9790-d4254b3daeca tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "DELETE /compute/v2.1/servers/f5e9e5b3-58c6-44f2-940a-c72b15dfd8db" status: 404 len: 111 microversion: 2.1 time: 0.030777 Aug 09 07:08:41.765805 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 389/780] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 9 07:08:41 2022] DELETE /compute/v2.1/servers/f5e9e5b3-58c6-44f2-940a-c72b15dfd8db => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 07:08:41.769693 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6ccc07b4-2e3e-4a4d-9db7-cb3183ef7b1d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:41.770301 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-6ccc07b4-2e3e-4a4d-9db7-cb3183ef7b1d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: f5e9e5b3-58c6-44f2-940a-c72b15dfd8db] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:41.776862 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6ccc07b4-2e3e-4a4d-9db7-cb3183ef7b1d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:41.777279 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6ccc07b4-2e3e-4a4d-9db7-cb3183ef7b1d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:41.777706 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6ccc07b4-2e3e-4a4d-9db7-cb3183ef7b1d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:41.778378 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6ccc07b4-2e3e-4a4d-9db7-cb3183ef7b1d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:41.778823 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6ccc07b4-2e3e-4a4d-9db7-cb3183ef7b1d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:41.779240 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6ccc07b4-2e3e-4a4d-9db7-cb3183ef7b1d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:41.792881 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-6ccc07b4-2e3e-4a4d-9db7-cb3183ef7b1d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] HTTP exception thrown: Instance f5e9e5b3-58c6-44f2-940a-c72b15dfd8db could not be found. Aug 09 07:08:41.794365 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6ccc07b4-2e3e-4a4d-9db7-cb3183ef7b1d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Request method failure captured: Aug 09 07:08:41.794365 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/f5e9e5b3-58c6-44f2-940a-c72b15dfd8db HTTP/1.1 Aug 09 07:08:41.794365 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 09 07:08:41.794365 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 09 07:08:41.794365 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Connection: close Aug 09 07:08:41.794365 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Length: 0 Aug 09 07:08:41.794365 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 09 07:08:41.794365 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.30 Aug 09 07:08:41.794365 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 09 07:08:41.794365 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.11 Aug 09 07:08:41.794365 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi8gaG96fR8jlKQ8TiHSUILZSO2wcQMYr69tPNs3VsPdBbduE5q2N89Qfor1fKdUNuu3cU5AkFy4zL1QPl7jYp6fw9XYg8hg0IW6MscBdP4L-HtUgUgXdSQOw3p3as0Mug0wzwISkStMEUz2JvWC4HKwrWVHwt0TNvR0CveB6NheFq7RI Aug 09 07:08:41.794365 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 09 07:08:41.794365 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 09 07:08:41.794365 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 09 07:08:41.794365 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 09 07:08:41.794365 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 09 07:08:41.794365 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 09 07:08:41.794365 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Id: f38c6aa37b9643bbbe5bb7fd3efde4fd Aug 09 07:08:41.794365 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-AttachVolumeNegativeTest-2082484098 Aug 09 07:08:41.794365 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 09 07:08:41.794365 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 09 07:08:41.795975 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f38c6aa37b9643bbbe5bb7fd3efde4fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f38c6aa37b9643bbbe5bb7fd3efde4fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f38c6aa37b9643bbbe5bb7fd3efde4fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f38c6aa37b9643bbbe5bb7fd3efde4fd"}]}] Aug 09 07:08:41.795975 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-AttachVolumeNegativeTest-2082484098 Aug 09 07:08:41.795975 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: f38c6aa37b9643bbbe5bb7fd3efde4fd Aug 09 07:08:41.795975 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2082484098 Aug 09 07:08:41.795975 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User: tempest-AttachVolumeNegativeTest-2082484098-project Aug 09 07:08:41.795975 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 09 07:08:41.795975 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 09 07:08:41.795975 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Id: cc885026afe041cca086367bb67d8a9b Aug 09 07:08:41.795975 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-AttachVolumeNegativeTest-2082484098-project Aug 09 07:08:41.795975 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: method: > Aug 09 07:08:41.795975 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: exception: Instance f5e9e5b3-58c6-44f2-940a-c72b15dfd8db could not be found. Aug 09 07:08:41.795975 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: action_args: {'id': 'f5e9e5b3-58c6-44f2-940a-c72b15dfd8db'} Aug 09 07:08:41.796742 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 07:08:41.796742 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:08:41.796742 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 07:08:41.796742 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 07:08:41.796742 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 07:08:41.796742 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 07:08:41.796742 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 07:08:41.796742 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 07:08:41.796742 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 07:08:41.796742 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 07:08:41.796742 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5e9e5b3-58c6-44f2-940a-c72b15dfd8db could not be found. Aug 09 07:08:41.796742 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:08:41.796742 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:08:41.796742 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:08:41.796742 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:08:41.796742 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:08:41.796742 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:08:41.796742 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 07:08:41.796742 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 07:08:41.796742 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 07:08:41.797946 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 07:08:41.797946 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 07:08:41.797946 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 07:08:41.797946 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 07:08:41.797946 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 07:08:41.797946 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 07:08:41.797946 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 07:08:41.797946 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5e9e5b3-58c6-44f2-940a-c72b15dfd8db could not be found. Aug 09 07:08:41.797946 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:08:41.797946 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:08:41.797946 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:08:41.797946 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:08:41.797946 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:08:41.797946 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:08:41.797946 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 07:08:41.797946 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 07:08:41.797946 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5e9e5b3-58c6-44f2-940a-c72b15dfd8db could not be found. Aug 09 07:08:41.797946 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:08:41.798994 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6ccc07b4-2e3e-4a4d-9db7-cb3183ef7b1d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Returning 404 to user: Instance f5e9e5b3-58c6-44f2-940a-c72b15dfd8db could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 07:08:41.798994 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-6ccc07b4-2e3e-4a4d-9db7-cb3183ef7b1d tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/f5e9e5b3-58c6-44f2-940a-c72b15dfd8db" status: 404 len: 111 microversion: 2.1 time: 0.029827 Aug 09 07:08:41.798994 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 392/781] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:08:41 2022] GET /compute/v2.1/servers/f5e9e5b3-58c6-44f2-940a-c72b15dfd8db => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 07:08:42.313953 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-ba97e700-75a8-4bbb-9ddb-d131ff28218a tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:42.314735 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-ba97e700-75a8-4bbb-9ddb-d131ff28218a tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:42.320798 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ba97e700-75a8-4bbb-9ddb-d131ff28218a tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:42.321650 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ba97e700-75a8-4bbb-9ddb-d131ff28218a tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:42.322153 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ba97e700-75a8-4bbb-9ddb-d131ff28218a tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:42.323795 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ba97e700-75a8-4bbb-9ddb-d131ff28218a tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:42.324364 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ba97e700-75a8-4bbb-9ddb-d131ff28218a tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:42.324836 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ba97e700-75a8-4bbb-9ddb-d131ff28218a tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:42.343239 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.wsgi [None req-ba97e700-75a8-4bbb-9ddb-d131ff28218a tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] HTTP exception thrown: Instance 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 could not be found. Aug 09 07:08:42.345487 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-ba97e700-75a8-4bbb-9ddb-d131ff28218a tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Request method failure captured: Aug 09 07:08:42.345487 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: request: DELETE /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 HTTP/1.1 Aug 09 07:08:42.345487 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Accept: application/json Aug 09 07:08:42.345487 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Accept-Encoding: identity Aug 09 07:08:42.345487 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Connection: close Aug 09 07:08:42.345487 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Content-Length: 0 Aug 09 07:08:42.345487 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Content-Type: application/json Aug 09 07:08:42.345487 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Host: 10.222.0.30 Aug 09 07:08:42.345487 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Openstack-System-Scope: None Aug 09 07:08:42.345487 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: User-Agent: python-urllib3/1.26.11 Aug 09 07:08:42.345487 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Auth-Token: gAAAAABi8gaPh4UD8Lvsts7n6cRYQXvOuIgw_ZpKGOaLWJmiZbPPEZm6jRgu3O-sdtpcq3g5nszKTXfwzuDu4siciDBluQpQob3JvdcaWweC2dNTEsiNm9r1lDGUUVuvJmpQzcw40bAADmfJbAvFpmuPblEml6zt8swHKHYmVIOErwAWIvlwC_A Aug 09 07:08:42.345487 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Domain-Id: None Aug 09 07:08:42.345487 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Domain-Name: None Aug 09 07:08:42.345487 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Identity-Status: Confirmed Aug 09 07:08:42.345487 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Is-Admin-Project: True Aug 09 07:08:42.345487 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Domain-Id: default Aug 09 07:08:42.345487 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Domain-Name: Default Aug 09 07:08:42.345487 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Id: b7ada2fd6ffa44df9345c13afb650496 Aug 09 07:08:42.345487 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Name: tempest-AttachVolumeTestJSON-1520792079 Aug 09 07:08:42.345487 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Role: reader,member Aug 09 07:08:42.345487 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Roles: reader,member Aug 09 07:08:42.347275 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b7ada2fd6ffa44df9345c13afb650496"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b7ada2fd6ffa44df9345c13afb650496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b7ada2fd6ffa44df9345c13afb650496"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b7ada2fd6ffa44df9345c13afb650496"}]}] Aug 09 07:08:42.347275 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant: tempest-AttachVolumeTestJSON-1520792079 Aug 09 07:08:42.347275 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant-Id: b7ada2fd6ffa44df9345c13afb650496 Aug 09 07:08:42.347275 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1520792079 Aug 09 07:08:42.347275 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User: tempest-AttachVolumeTestJSON-1520792079-project Aug 09 07:08:42.347275 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Domain-Id: default Aug 09 07:08:42.347275 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Domain-Name: Default Aug 09 07:08:42.347275 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Id: 4e528f53a4b94e0fab0d90e0dbe07216 Aug 09 07:08:42.347275 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Name: tempest-AttachVolumeTestJSON-1520792079-project Aug 09 07:08:42.347275 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: method: > Aug 09 07:08:42.347275 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: exception: Instance 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 could not be found. Aug 09 07:08:42.347275 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: action_args: {'id': '1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46'} Aug 09 07:08:42.351503 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 07:08:42.351503 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:08:42.351503 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 07:08:42.351503 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 07:08:42.351503 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 07:08:42.351503 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 07:08:42.351503 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 07:08:42.351503 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 07:08:42.351503 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 07:08:42.351503 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 07:08:42.351503 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 could not be found. Aug 09 07:08:42.351503 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:08:42.351503 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:08:42.351503 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:08:42.351503 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:08:42.351503 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:08:42.351503 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:08:42.351503 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 07:08:42.351503 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 07:08:42.351503 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 07:08:42.353102 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 07:08:42.353102 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 07:08:42.353102 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 07:08:42.353102 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 07:08:42.353102 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 07:08:42.353102 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 07:08:42.353102 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 07:08:42.353102 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 07:08:42.353102 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 07:08:42.353102 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 could not be found. Aug 09 07:08:42.353102 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:08:42.353102 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:08:42.353102 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:08:42.353102 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:08:42.353102 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:08:42.353102 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:08:42.353102 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 07:08:42.353102 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 07:08:42.353102 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 could not be found. Aug 09 07:08:42.353102 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:08:42.355688 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-ba97e700-75a8-4bbb-9ddb-d131ff28218a tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Returning 404 to user: Instance 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 could not be found. {{(pid=117858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 07:08:42.355688 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-ba97e700-75a8-4bbb-9ddb-d131ff28218a tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 404 len: 111 microversion: 2.1 time: 0.038661 Aug 09 07:08:42.355688 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 390/782] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 9 07:08:42 2022] DELETE /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 07:08:42.357816 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-96b6af1d-1944-4c2c-a0a6-16bc31c45c27 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:42.358430 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-96b6af1d-1944-4c2c-a0a6-16bc31c45c27 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] [instance: 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:42.364371 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-96b6af1d-1944-4c2c-a0a6-16bc31c45c27 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:42.364916 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-96b6af1d-1944-4c2c-a0a6-16bc31c45c27 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:42.365436 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-96b6af1d-1944-4c2c-a0a6-16bc31c45c27 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:42.366192 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-96b6af1d-1944-4c2c-a0a6-16bc31c45c27 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:42.366711 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-96b6af1d-1944-4c2c-a0a6-16bc31c45c27 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:42.367197 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-96b6af1d-1944-4c2c-a0a6-16bc31c45c27 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:42.381218 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-96b6af1d-1944-4c2c-a0a6-16bc31c45c27 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] HTTP exception thrown: Instance 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 could not be found. Aug 09 07:08:42.382877 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-96b6af1d-1944-4c2c-a0a6-16bc31c45c27 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Request method failure captured: Aug 09 07:08:42.382877 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 HTTP/1.1 Aug 09 07:08:42.382877 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 09 07:08:42.382877 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 09 07:08:42.382877 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Connection: close Aug 09 07:08:42.382877 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Length: 0 Aug 09 07:08:42.382877 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 09 07:08:42.382877 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.30 Aug 09 07:08:42.382877 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 09 07:08:42.382877 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.11 Aug 09 07:08:42.382877 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi8gaPh4UD8Lvsts7n6cRYQXvOuIgw_ZpKGOaLWJmiZbPPEZm6jRgu3O-sdtpcq3g5nszKTXfwzuDu4siciDBluQpQob3JvdcaWweC2dNTEsiNm9r1lDGUUVuvJmpQzcw40bAADmfJbAvFpmuPblEml6zt8swHKHYmVIOErwAWIvlwC_A Aug 09 07:08:42.382877 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 09 07:08:42.382877 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 09 07:08:42.382877 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 09 07:08:42.382877 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 09 07:08:42.382877 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 09 07:08:42.382877 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 09 07:08:42.382877 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Id: b7ada2fd6ffa44df9345c13afb650496 Aug 09 07:08:42.382877 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-AttachVolumeTestJSON-1520792079 Aug 09 07:08:42.382877 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 09 07:08:42.382877 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 09 07:08:42.384397 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b7ada2fd6ffa44df9345c13afb650496"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_b7ada2fd6ffa44df9345c13afb650496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/b7ada2fd6ffa44df9345c13afb650496"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/b7ada2fd6ffa44df9345c13afb650496"}]}] Aug 09 07:08:42.384397 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-AttachVolumeTestJSON-1520792079 Aug 09 07:08:42.384397 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: b7ada2fd6ffa44df9345c13afb650496 Aug 09 07:08:42.384397 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1520792079 Aug 09 07:08:42.384397 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User: tempest-AttachVolumeTestJSON-1520792079-project Aug 09 07:08:42.384397 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 09 07:08:42.384397 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 09 07:08:42.384397 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Id: 4e528f53a4b94e0fab0d90e0dbe07216 Aug 09 07:08:42.384397 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-AttachVolumeTestJSON-1520792079-project Aug 09 07:08:42.384397 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: method: > Aug 09 07:08:42.384397 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: exception: Instance 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 could not be found. Aug 09 07:08:42.384397 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: action_args: {'id': '1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46'} Aug 09 07:08:42.389195 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 07:08:42.389195 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:08:42.389195 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 07:08:42.389195 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 07:08:42.389195 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 07:08:42.389195 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 07:08:42.389195 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 07:08:42.389195 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 07:08:42.389195 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 07:08:42.389195 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 07:08:42.389195 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 could not be found. Aug 09 07:08:42.389195 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:08:42.389195 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:08:42.389195 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:08:42.389195 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:08:42.389195 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:08:42.389195 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:08:42.389195 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 07:08:42.389195 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 07:08:42.389195 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 07:08:42.390797 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 07:08:42.390797 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 07:08:42.390797 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 07:08:42.390797 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 07:08:42.390797 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 07:08:42.390797 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 07:08:42.390797 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 07:08:42.390797 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 could not be found. Aug 09 07:08:42.390797 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:08:42.390797 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:08:42.390797 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:08:42.390797 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:08:42.390797 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:08:42.390797 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:08:42.390797 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 07:08:42.390797 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 07:08:42.390797 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 could not be found. Aug 09 07:08:42.390797 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:08:42.391940 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-96b6af1d-1944-4c2c-a0a6-16bc31c45c27 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] Returning 404 to user: Instance 1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 07:08:42.391940 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-96b6af1d-1944-4c2c-a0a6-16bc31c45c27 tempest-AttachVolumeTestJSON-1520792079 tempest-AttachVolumeTestJSON-1520792079-project] 10.222.0.30 "GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46" status: 404 len: 111 microversion: 2.1 time: 0.032034 Aug 09 07:08:42.391940 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 393/783] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:08:42 2022] GET /compute/v2.1/servers/1ef7cfe7-c011-436b-8dc2-a4d5a1c55d46 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 07:08:42.936633 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-b98ab473-42b3-4e20-a063-39be5be250ef tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:42.937221 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-b98ab473-42b3-4e20-a063-39be5be250ef tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: 66d40f73-633e-4564-a6d4-732cd15dcb12] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:42.943380 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b98ab473-42b3-4e20-a063-39be5be250ef tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:42.943896 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b98ab473-42b3-4e20-a063-39be5be250ef tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:42.944326 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b98ab473-42b3-4e20-a063-39be5be250ef tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:42.945210 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b98ab473-42b3-4e20-a063-39be5be250ef tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:42.945657 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b98ab473-42b3-4e20-a063-39be5be250ef tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:42.946084 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b98ab473-42b3-4e20-a063-39be5be250ef tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:42.959557 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.wsgi [None req-b98ab473-42b3-4e20-a063-39be5be250ef tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] HTTP exception thrown: Instance 66d40f73-633e-4564-a6d4-732cd15dcb12 could not be found. Aug 09 07:08:42.961117 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-b98ab473-42b3-4e20-a063-39be5be250ef tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Request method failure captured: Aug 09 07:08:42.961117 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: request: DELETE /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12 HTTP/1.1 Aug 09 07:08:42.961117 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Accept: application/json Aug 09 07:08:42.961117 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Accept-Encoding: identity Aug 09 07:08:42.961117 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Connection: close Aug 09 07:08:42.961117 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Content-Length: 0 Aug 09 07:08:42.961117 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Content-Type: application/json Aug 09 07:08:42.961117 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Host: 10.222.0.30 Aug 09 07:08:42.961117 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Openstack-System-Scope: None Aug 09 07:08:42.961117 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: User-Agent: python-urllib3/1.26.11 Aug 09 07:08:42.961117 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Auth-Token: gAAAAABi8gaG96fR8jlKQ8TiHSUILZSO2wcQMYr69tPNs3VsPdBbduE5q2N89Qfor1fKdUNuu3cU5AkFy4zL1QPl7jYp6fw9XYg8hg0IW6MscBdP4L-HtUgUgXdSQOw3p3as0Mug0wzwISkStMEUz2JvWC4HKwrWVHwt0TNvR0CveB6NheFq7RI Aug 09 07:08:42.961117 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Domain-Id: None Aug 09 07:08:42.961117 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Domain-Name: None Aug 09 07:08:42.961117 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Identity-Status: Confirmed Aug 09 07:08:42.961117 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Is-Admin-Project: True Aug 09 07:08:42.961117 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Domain-Id: default Aug 09 07:08:42.961117 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Domain-Name: Default Aug 09 07:08:42.961117 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Id: f38c6aa37b9643bbbe5bb7fd3efde4fd Aug 09 07:08:42.961117 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Name: tempest-AttachVolumeNegativeTest-2082484098 Aug 09 07:08:42.961117 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Role: reader,member Aug 09 07:08:42.961117 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Roles: reader,member Aug 09 07:08:42.962740 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f38c6aa37b9643bbbe5bb7fd3efde4fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f38c6aa37b9643bbbe5bb7fd3efde4fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f38c6aa37b9643bbbe5bb7fd3efde4fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f38c6aa37b9643bbbe5bb7fd3efde4fd"}]}] Aug 09 07:08:42.962740 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant: tempest-AttachVolumeNegativeTest-2082484098 Aug 09 07:08:42.962740 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant-Id: f38c6aa37b9643bbbe5bb7fd3efde4fd Aug 09 07:08:42.962740 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2082484098 Aug 09 07:08:42.962740 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User: tempest-AttachVolumeNegativeTest-2082484098-project Aug 09 07:08:42.962740 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Domain-Id: default Aug 09 07:08:42.962740 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Domain-Name: Default Aug 09 07:08:42.962740 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Id: cc885026afe041cca086367bb67d8a9b Aug 09 07:08:42.962740 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Name: tempest-AttachVolumeNegativeTest-2082484098-project Aug 09 07:08:42.962740 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: method: > Aug 09 07:08:42.962740 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: exception: Instance 66d40f73-633e-4564-a6d4-732cd15dcb12 could not be found. Aug 09 07:08:42.962740 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: action_args: {'id': '66d40f73-633e-4564-a6d4-732cd15dcb12'} Aug 09 07:08:42.964155 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 07:08:42.964155 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:08:42.964155 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 07:08:42.964155 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 07:08:42.964155 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 07:08:42.964155 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 07:08:42.964155 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 07:08:42.964155 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 07:08:42.964155 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 07:08:42.964155 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 07:08:42.964155 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66d40f73-633e-4564-a6d4-732cd15dcb12 could not be found. Aug 09 07:08:42.964155 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:08:42.964155 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:08:42.964155 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:08:42.964155 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:08:42.964155 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:08:42.964155 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:08:42.964155 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 07:08:42.964155 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 07:08:42.964155 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 07:08:42.965367 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 07:08:42.965367 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 07:08:42.965367 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 07:08:42.965367 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 07:08:42.965367 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 07:08:42.965367 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 07:08:42.965367 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 07:08:42.965367 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 07:08:42.965367 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 07:08:42.965367 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66d40f73-633e-4564-a6d4-732cd15dcb12 could not be found. Aug 09 07:08:42.965367 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:08:42.965367 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:08:42.965367 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:08:42.965367 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:08:42.965367 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:08:42.965367 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:08:42.965367 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 07:08:42.965367 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 07:08:42.965367 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66d40f73-633e-4564-a6d4-732cd15dcb12 could not be found. Aug 09 07:08:42.965367 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:08:42.966556 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-b98ab473-42b3-4e20-a063-39be5be250ef tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Returning 404 to user: Instance 66d40f73-633e-4564-a6d4-732cd15dcb12 could not be found. {{(pid=117858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 07:08:42.966556 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-b98ab473-42b3-4e20-a063-39be5be250ef tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "DELETE /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12" status: 404 len: 111 microversion: 2.1 time: 0.029890 Aug 09 07:08:42.966556 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 391/784] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 9 07:08:42 2022] DELETE /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 07:08:42.971910 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-07251c27-ed42-4f03-b585-0af6fabb050a tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:42.972525 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-07251c27-ed42-4f03-b585-0af6fabb050a tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] [instance: 66d40f73-633e-4564-a6d4-732cd15dcb12] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:42.979775 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-07251c27-ed42-4f03-b585-0af6fabb050a tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:42.980265 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-07251c27-ed42-4f03-b585-0af6fabb050a tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:42.980695 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-07251c27-ed42-4f03-b585-0af6fabb050a tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:42.981386 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-07251c27-ed42-4f03-b585-0af6fabb050a tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:42.981836 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-07251c27-ed42-4f03-b585-0af6fabb050a tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:42.982257 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-07251c27-ed42-4f03-b585-0af6fabb050a tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:42.996858 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-07251c27-ed42-4f03-b585-0af6fabb050a tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] HTTP exception thrown: Instance 66d40f73-633e-4564-a6d4-732cd15dcb12 could not be found. Aug 09 07:08:42.998380 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-07251c27-ed42-4f03-b585-0af6fabb050a tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Request method failure captured: Aug 09 07:08:42.998380 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12 HTTP/1.1 Aug 09 07:08:42.998380 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 09 07:08:42.998380 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 09 07:08:42.998380 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Connection: close Aug 09 07:08:42.998380 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Length: 0 Aug 09 07:08:42.998380 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 09 07:08:42.998380 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.30 Aug 09 07:08:42.998380 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 09 07:08:42.998380 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.11 Aug 09 07:08:42.998380 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi8gaG96fR8jlKQ8TiHSUILZSO2wcQMYr69tPNs3VsPdBbduE5q2N89Qfor1fKdUNuu3cU5AkFy4zL1QPl7jYp6fw9XYg8hg0IW6MscBdP4L-HtUgUgXdSQOw3p3as0Mug0wzwISkStMEUz2JvWC4HKwrWVHwt0TNvR0CveB6NheFq7RI Aug 09 07:08:42.998380 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 09 07:08:42.998380 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 09 07:08:42.998380 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 09 07:08:42.998380 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 09 07:08:42.998380 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 09 07:08:42.998380 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 09 07:08:42.998380 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Id: f38c6aa37b9643bbbe5bb7fd3efde4fd Aug 09 07:08:42.998380 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-AttachVolumeNegativeTest-2082484098 Aug 09 07:08:42.998380 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 09 07:08:42.998380 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 09 07:08:42.999702 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f38c6aa37b9643bbbe5bb7fd3efde4fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_f38c6aa37b9643bbbe5bb7fd3efde4fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/f38c6aa37b9643bbbe5bb7fd3efde4fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/f38c6aa37b9643bbbe5bb7fd3efde4fd"}]}] Aug 09 07:08:42.999702 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-AttachVolumeNegativeTest-2082484098 Aug 09 07:08:42.999702 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: f38c6aa37b9643bbbe5bb7fd3efde4fd Aug 09 07:08:42.999702 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2082484098 Aug 09 07:08:42.999702 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User: tempest-AttachVolumeNegativeTest-2082484098-project Aug 09 07:08:42.999702 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 09 07:08:42.999702 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 09 07:08:42.999702 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Id: cc885026afe041cca086367bb67d8a9b Aug 09 07:08:42.999702 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-AttachVolumeNegativeTest-2082484098-project Aug 09 07:08:42.999702 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: method: > Aug 09 07:08:42.999702 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: exception: Instance 66d40f73-633e-4564-a6d4-732cd15dcb12 could not be found. Aug 09 07:08:42.999702 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: action_args: {'id': '66d40f73-633e-4564-a6d4-732cd15dcb12'} Aug 09 07:08:43.000492 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 07:08:43.000492 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:08:43.000492 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 07:08:43.000492 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 07:08:43.000492 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 07:08:43.000492 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 07:08:43.000492 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 07:08:43.000492 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 07:08:43.000492 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 07:08:43.000492 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 07:08:43.000492 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66d40f73-633e-4564-a6d4-732cd15dcb12 could not be found. Aug 09 07:08:43.000492 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:08:43.000492 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:08:43.000492 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:08:43.000492 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:08:43.000492 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:08:43.000492 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:08:43.000492 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 07:08:43.000492 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 07:08:43.000492 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 07:08:43.001667 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 07:08:43.001667 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 07:08:43.001667 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 07:08:43.001667 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 07:08:43.001667 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 07:08:43.001667 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 07:08:43.001667 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 07:08:43.001667 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66d40f73-633e-4564-a6d4-732cd15dcb12 could not be found. Aug 09 07:08:43.001667 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:08:43.001667 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:08:43.001667 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:08:43.001667 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:08:43.001667 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:08:43.001667 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:08:43.001667 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 07:08:43.001667 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 07:08:43.001667 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66d40f73-633e-4564-a6d4-732cd15dcb12 could not be found. Aug 09 07:08:43.001667 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:08:43.002971 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-07251c27-ed42-4f03-b585-0af6fabb050a tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] Returning 404 to user: Instance 66d40f73-633e-4564-a6d4-732cd15dcb12 could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 07:08:43.002971 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-07251c27-ed42-4f03-b585-0af6fabb050a tempest-AttachVolumeNegativeTest-2082484098 tempest-AttachVolumeNegativeTest-2082484098-project] 10.222.0.30 "GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12" status: 404 len: 111 microversion: 2.1 time: 0.031782 Aug 09 07:08:43.002971 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 394/785] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:08:42 2022] GET /compute/v2.1/servers/66d40f73-633e-4564-a6d4-732cd15dcb12 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 07:08:59.019029 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-3d65ea0a-5913-45e3-a38a-ae581c044c03 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:59.021545 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-3d65ea0a-5913-45e3-a38a-ae581c044c03 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:59.023931 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=2 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:08:59.024647 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=1 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:08:59.030097 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3d65ea0a-5913-45e3-a38a-ae581c044c03 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:59.030770 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3d65ea0a-5913-45e3-a38a-ae581c044c03 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:59.031406 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3d65ea0a-5913-45e3-a38a-ae581c044c03 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:59.032159 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3d65ea0a-5913-45e3-a38a-ae581c044c03 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:59.032793 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3d65ea0a-5913-45e3-a38a-ae581c044c03 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:59.033221 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3d65ea0a-5913-45e3-a38a-ae581c044c03 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:59.069146 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-3d65ea0a-5913-45e3-a38a-ae581c044c03 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.054436 Aug 09 07:08:59.069675 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 392/786] 10.222.0.30 () {60 vars in 1343 bytes} [Tue Aug 9 07:08:59 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:08:59.136461 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-555ca0a5-32d4-4461-89de-21ea38f4e829 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:59.137508 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-555ca0a5-32d4-4461-89de-21ea38f4e829 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:59.151424 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:08:59.152426 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:08:59.155523 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-555ca0a5-32d4-4461-89de-21ea38f4e829 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:59.156323 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-555ca0a5-32d4-4461-89de-21ea38f4e829 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:59.156989 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-555ca0a5-32d4-4461-89de-21ea38f4e829 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:59.157935 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-555ca0a5-32d4-4461-89de-21ea38f4e829 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:59.158591 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-555ca0a5-32d4-4461-89de-21ea38f4e829 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:59.159255 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-555ca0a5-32d4-4461-89de-21ea38f4e829 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:59.189711 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-555ca0a5-32d4-4461-89de-21ea38f4e829 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Going to try to terminate instance {{(pid=117859) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 07:08:59.281690 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-555ca0a5-32d4-4461-89de-21ea38f4e829 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "DELETE /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 204 len: 0 microversion: 2.20 time: 0.149391 Aug 09 07:08:59.282910 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 395/787] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Aug 9 07:08:59 2022] DELETE /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 07:08:59.293545 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-1ea600f3-8c26-439a-9be3-407a5828ffdd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:08:59.294461 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-1ea600f3-8c26-439a-9be3-407a5828ffdd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:08:59.301181 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1ea600f3-8c26-439a-9be3-407a5828ffdd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:59.301887 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1ea600f3-8c26-439a-9be3-407a5828ffdd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:59.302501 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1ea600f3-8c26-439a-9be3-407a5828ffdd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:59.303522 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1ea600f3-8c26-439a-9be3-407a5828ffdd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:08:59.304015 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1ea600f3-8c26-439a-9be3-407a5828ffdd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:08:59.304445 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1ea600f3-8c26-439a-9be3-407a5828ffdd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:08:59.452094 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-1ea600f3-8c26-439a-9be3-407a5828ffdd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:59.465040 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-1ea600f3-8c26-439a-9be3-407a5828ffdd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:59.467002 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-1ea600f3-8c26-439a-9be3-407a5828ffdd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:08:59.469374 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-1ea600f3-8c26-439a-9be3-407a5828ffdd tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 200 len: 1723 microversion: 2.20 time: 0.181379 Aug 09 07:08:59.483629 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 393/788] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:08:59 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:09:00.493600 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e5d70f25-83f5-449b-b94c-51448e7a269d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:09:00.494581 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-e5d70f25-83f5-449b-b94c-51448e7a269d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:09:00.500918 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e5d70f25-83f5-449b-b94c-51448e7a269d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:09:00.501398 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e5d70f25-83f5-449b-b94c-51448e7a269d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:09:00.501832 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e5d70f25-83f5-449b-b94c-51448e7a269d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:09:00.502794 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e5d70f25-83f5-449b-b94c-51448e7a269d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:09:00.503248 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e5d70f25-83f5-449b-b94c-51448e7a269d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:09:00.503712 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e5d70f25-83f5-449b-b94c-51448e7a269d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:09:00.637715 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e5d70f25-83f5-449b-b94c-51448e7a269d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:09:00.647536 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e5d70f25-83f5-449b-b94c-51448e7a269d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:09:00.649286 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e5d70f25-83f5-449b-b94c-51448e7a269d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:09:00.650509 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-e5d70f25-83f5-449b-b94c-51448e7a269d tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 200 len: 1723 microversion: 2.20 time: 0.161200 Aug 09 07:09:00.651067 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 396/789] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:09:00 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:09:01.504241 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [req-8d5df8da-f7c8-4085-81ed-6e6219476697 req-2f85f06b-805e-45f6-b7b7-37a15c86ca4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf38e7a7-b39a-4966-aa2d-effc83a555b8", "name": "network-vif-deleted", "tag": "067648c9-4dd9-4848-a425-3cbbac00eedd"}]} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:09:01.516017 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-8d5df8da-f7c8-4085-81ed-6e6219476697 req-2f85f06b-805e-45f6-b7b7-37a15c86ca4e service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:09:01.516525 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-8d5df8da-f7c8-4085-81ed-6e6219476697 req-2f85f06b-805e-45f6-b7b7-37a15c86ca4e service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:09:01.516964 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-8d5df8da-f7c8-4085-81ed-6e6219476697 req-2f85f06b-805e-45f6-b7b7-37a15c86ca4e service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:09:01.530985 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.compute.server_external_events [req-8d5df8da-f7c8-4085-81ed-6e6219476697 req-2f85f06b-805e-45f6-b7b7-37a15c86ca4e service nova] Creating event network-vif-deleted:067648c9-4dd9-4848-a425-3cbbac00eedd for instance cf38e7a7-b39a-4966-aa2d-effc83a555b8 on hv-cinder-85251 Aug 09 07:09:01.537730 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [req-8d5df8da-f7c8-4085-81ed-6e6219476697 req-2f85f06b-805e-45f6-b7b7-37a15c86ca4e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038558 Aug 09 07:09:01.541929 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 394/790] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 07:09:01.676302 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-18704986-474f-4494-8f13-4249d9398dac tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:09:01.678143 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-18704986-474f-4494-8f13-4249d9398dac tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:09:01.686507 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-18704986-474f-4494-8f13-4249d9398dac tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:09:01.686992 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-18704986-474f-4494-8f13-4249d9398dac tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:09:01.687428 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-18704986-474f-4494-8f13-4249d9398dac tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:09:01.688551 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-18704986-474f-4494-8f13-4249d9398dac tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:09:01.689199 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-18704986-474f-4494-8f13-4249d9398dac tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:09:01.689793 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-18704986-474f-4494-8f13-4249d9398dac tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:09:01.731016 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-18704986-474f-4494-8f13-4249d9398dac tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:09:01.731895 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-18704986-474f-4494-8f13-4249d9398dac tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:09:01.732490 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-18704986-474f-4494-8f13-4249d9398dac tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:09:01.733107 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.objects.instance [None req-18704986-474f-4494-8f13-4249d9398dac tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lazy-loading 'fault' on Instance uuid cf38e7a7-b39a-4966-aa2d-effc83a555b8 {{(pid=117859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 07:09:01.784424 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-18704986-474f-4494-8f13-4249d9398dac tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:09:01.792734 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-18704986-474f-4494-8f13-4249d9398dac tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:09:01.794229 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-18704986-474f-4494-8f13-4249d9398dac tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0bb72c5f52fc498aa60eecba3bd5248a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c7e20a9669439fa43853dab6f9851c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:09:01.795384 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-18704986-474f-4494-8f13-4249d9398dac tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 200 len: 1371 microversion: 2.20 time: 0.124955 Aug 09 07:09:01.795972 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 397/791] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:09:01 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 1371 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 09 07:09:02.818811 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-04015760-228f-4a11-baf6-bb62e97b0bd0 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:09:02.820107 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-04015760-228f-4a11-baf6-bb62e97b0bd0 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:09:02.826203 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-04015760-228f-4a11-baf6-bb62e97b0bd0 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:09:02.826690 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-04015760-228f-4a11-baf6-bb62e97b0bd0 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:09:02.827125 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-04015760-228f-4a11-baf6-bb62e97b0bd0 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:09:02.827848 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-04015760-228f-4a11-baf6-bb62e97b0bd0 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:09:02.828300 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-04015760-228f-4a11-baf6-bb62e97b0bd0 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:09:02.828722 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-04015760-228f-4a11-baf6-bb62e97b0bd0 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:09:02.843130 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.wsgi [None req-04015760-228f-4a11-baf6-bb62e97b0bd0 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] HTTP exception thrown: Instance cf38e7a7-b39a-4966-aa2d-effc83a555b8 could not be found. Aug 09 07:09:02.844852 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-04015760-228f-4a11-baf6-bb62e97b0bd0 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Request method failure captured: Aug 09 07:09:02.844852 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: request: GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 HTTP/1.1 Aug 09 07:09:02.844852 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Accept: application/json Aug 09 07:09:02.844852 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Accept-Encoding: identity Aug 09 07:09:02.844852 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Connection: close Aug 09 07:09:02.844852 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Content-Length: 0 Aug 09 07:09:02.844852 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Content-Type: application/json Aug 09 07:09:02.844852 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Host: 10.222.0.30 Aug 09 07:09:02.844852 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Openstack-System-Scope: None Aug 09 07:09:02.844852 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: User-Agent: python-urllib3/1.26.11 Aug 09 07:09:02.844852 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Auth-Token: gAAAAABi8gaRnSbbfLxfTalYzBSaazV26j8bqFLOBP1hFBUp7vKdmILNtFaGrVx8tLaUtHWXCdnAqpWrDgpK4RVv38wYFHwiqywSOI5IHzDHuiAQSIwLgKz7VDBMeuVzxM3n4zrHUJggy_VUwD22etwQ6V3CGPMPurPyE0ajsYjBVLVrwiTEU0M Aug 09 07:09:02.844852 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Domain-Id: None Aug 09 07:09:02.844852 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Domain-Name: None Aug 09 07:09:02.844852 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Identity-Status: Confirmed Aug 09 07:09:02.844852 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Is-Admin-Project: True Aug 09 07:09:02.844852 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 07:09:02.844852 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Domain-Id: default Aug 09 07:09:02.844852 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Domain-Name: Default Aug 09 07:09:02.844852 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Id: 10c7e20a9669439fa43853dab6f9851c Aug 09 07:09:02.844852 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2041815482 Aug 09 07:09:02.844852 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Role: reader,member Aug 09 07:09:02.844852 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Roles: reader,member Aug 09 07:09:02.846576 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/10c7e20a9669439fa43853dab6f9851c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_10c7e20a9669439fa43853dab6f9851c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/10c7e20a9669439fa43853dab6f9851c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/10c7e20a9669439fa43853dab6f9851c"}]}] Aug 09 07:09:02.846576 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2041815482 Aug 09 07:09:02.846576 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant-Id: 10c7e20a9669439fa43853dab6f9851c Aug 09 07:09:02.846576 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2041815482 Aug 09 07:09:02.846576 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User: tempest-AttachVolumeShelveTestJSON-2041815482-project Aug 09 07:09:02.846576 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Domain-Id: default Aug 09 07:09:02.846576 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Domain-Name: Default Aug 09 07:09:02.846576 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Id: 0bb72c5f52fc498aa60eecba3bd5248a Aug 09 07:09:02.846576 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2041815482-project Aug 09 07:09:02.846576 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: method: > Aug 09 07:09:02.846576 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: exception: Instance cf38e7a7-b39a-4966-aa2d-effc83a555b8 could not be found. Aug 09 07:09:02.846576 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: action_args: {'id': 'cf38e7a7-b39a-4966-aa2d-effc83a555b8'} Aug 09 07:09:02.847568 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 07:09:02.847568 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:09:02.847568 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 07:09:02.847568 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 07:09:02.847568 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 07:09:02.847568 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 07:09:02.847568 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 07:09:02.847568 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 07:09:02.847568 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 07:09:02.847568 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 07:09:02.847568 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf38e7a7-b39a-4966-aa2d-effc83a555b8 could not be found. Aug 09 07:09:02.847568 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:09:02.847568 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:09:02.847568 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:09:02.847568 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:09:02.847568 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:09:02.847568 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:09:02.847568 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 07:09:02.847568 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 07:09:02.847568 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 07:09:02.849297 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 07:09:02.849297 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 07:09:02.849297 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 07:09:02.849297 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 07:09:02.849297 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 07:09:02.849297 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 07:09:02.849297 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 07:09:02.849297 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf38e7a7-b39a-4966-aa2d-effc83a555b8 could not be found. Aug 09 07:09:02.849297 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:09:02.849297 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:09:02.849297 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:09:02.849297 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:09:02.849297 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:09:02.849297 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:09:02.849297 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 07:09:02.849297 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 07:09:02.849297 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf38e7a7-b39a-4966-aa2d-effc83a555b8 could not be found. Aug 09 07:09:02.849297 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:09:02.850763 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-04015760-228f-4a11-baf6-bb62e97b0bd0 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Returning 404 to user: Instance cf38e7a7-b39a-4966-aa2d-effc83a555b8 could not be found. {{(pid=117858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 07:09:02.850763 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-04015760-228f-4a11-baf6-bb62e97b0bd0 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 404 len: 111 microversion: 2.20 time: 0.031538 Aug 09 07:09:02.850763 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 395/792] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:09:02 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 07:09:02.857318 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-1f8b33ea-fa70-432a-a071-f28706c9f874 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '.version_select at 0x7f20dd2fc9d0>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:09:02.879283 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-1f8b33ea-fa70-432a-a071-f28706c9f874 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1488813531" status: 204 len: 0 microversion: 2.20 time: 0.027030 Aug 09 07:09:02.883430 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 398/793] 10.222.0.30 () {60 vars in 1262 bytes} [Tue Aug 9 07:09:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1488813531 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 09 07:09:04.803811 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-6068d026-e647-40e6-a56b-6952512c3601 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:09:04.804823 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-6068d026-e647-40e6-a56b-6952512c3601 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:09:04.811257 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6068d026-e647-40e6-a56b-6952512c3601 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:09:04.812033 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6068d026-e647-40e6-a56b-6952512c3601 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:09:04.812427 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6068d026-e647-40e6-a56b-6952512c3601 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:09:04.813135 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6068d026-e647-40e6-a56b-6952512c3601 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:09:04.813808 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6068d026-e647-40e6-a56b-6952512c3601 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:09:04.814196 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6068d026-e647-40e6-a56b-6952512c3601 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:09:04.829079 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.wsgi [None req-6068d026-e647-40e6-a56b-6952512c3601 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] HTTP exception thrown: Instance cf38e7a7-b39a-4966-aa2d-effc83a555b8 could not be found. Aug 09 07:09:04.830909 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-6068d026-e647-40e6-a56b-6952512c3601 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Request method failure captured: Aug 09 07:09:04.830909 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: request: DELETE /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 HTTP/1.1 Aug 09 07:09:04.830909 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Accept: application/json Aug 09 07:09:04.830909 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Accept-Encoding: identity Aug 09 07:09:04.830909 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Connection: close Aug 09 07:09:04.830909 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Content-Length: 0 Aug 09 07:09:04.830909 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Content-Type: application/json Aug 09 07:09:04.830909 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Host: 10.222.0.30 Aug 09 07:09:04.830909 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Openstack-System-Scope: None Aug 09 07:09:04.830909 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: User-Agent: python-urllib3/1.26.11 Aug 09 07:09:04.830909 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Auth-Token: gAAAAABi8gaRnSbbfLxfTalYzBSaazV26j8bqFLOBP1hFBUp7vKdmILNtFaGrVx8tLaUtHWXCdnAqpWrDgpK4RVv38wYFHwiqywSOI5IHzDHuiAQSIwLgKz7VDBMeuVzxM3n4zrHUJggy_VUwD22etwQ6V3CGPMPurPyE0ajsYjBVLVrwiTEU0M Aug 09 07:09:04.830909 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Domain-Id: None Aug 09 07:09:04.830909 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Domain-Name: None Aug 09 07:09:04.830909 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Identity-Status: Confirmed Aug 09 07:09:04.830909 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Is-Admin-Project: True Aug 09 07:09:04.830909 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 07:09:04.830909 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Domain-Id: default Aug 09 07:09:04.830909 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Domain-Name: Default Aug 09 07:09:04.830909 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Id: 10c7e20a9669439fa43853dab6f9851c Aug 09 07:09:04.830909 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2041815482 Aug 09 07:09:04.830909 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Role: reader,member Aug 09 07:09:04.830909 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Roles: reader,member Aug 09 07:09:04.832414 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/10c7e20a9669439fa43853dab6f9851c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_10c7e20a9669439fa43853dab6f9851c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/10c7e20a9669439fa43853dab6f9851c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/10c7e20a9669439fa43853dab6f9851c"}]}] Aug 09 07:09:04.832414 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2041815482 Aug 09 07:09:04.832414 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant-Id: 10c7e20a9669439fa43853dab6f9851c Aug 09 07:09:04.832414 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2041815482 Aug 09 07:09:04.832414 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User: tempest-AttachVolumeShelveTestJSON-2041815482-project Aug 09 07:09:04.832414 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Domain-Id: default Aug 09 07:09:04.832414 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Domain-Name: Default Aug 09 07:09:04.832414 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Id: 0bb72c5f52fc498aa60eecba3bd5248a Aug 09 07:09:04.832414 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2041815482-project Aug 09 07:09:04.832414 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: method: > Aug 09 07:09:04.832414 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: exception: Instance cf38e7a7-b39a-4966-aa2d-effc83a555b8 could not be found. Aug 09 07:09:04.832414 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: action_args: {'id': 'cf38e7a7-b39a-4966-aa2d-effc83a555b8'} Aug 09 07:09:04.833206 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 07:09:04.833206 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:09:04.833206 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 07:09:04.833206 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 07:09:04.833206 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 07:09:04.833206 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 07:09:04.833206 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 07:09:04.833206 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 07:09:04.833206 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 07:09:04.833206 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 07:09:04.833206 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf38e7a7-b39a-4966-aa2d-effc83a555b8 could not be found. Aug 09 07:09:04.833206 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:09:04.833206 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:09:04.833206 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:09:04.833206 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:09:04.833206 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:09:04.833206 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:09:04.833206 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 07:09:04.833206 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 07:09:04.833206 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 07:09:04.834419 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 07:09:04.834419 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 07:09:04.834419 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 07:09:04.834419 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 07:09:04.834419 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 07:09:04.834419 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 07:09:04.834419 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 07:09:04.834419 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 07:09:04.834419 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 07:09:04.834419 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf38e7a7-b39a-4966-aa2d-effc83a555b8 could not be found. Aug 09 07:09:04.834419 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:09:04.834419 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:09:04.834419 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:09:04.834419 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:09:04.834419 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:09:04.834419 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:09:04.834419 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 07:09:04.834419 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 07:09:04.834419 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf38e7a7-b39a-4966-aa2d-effc83a555b8 could not be found. Aug 09 07:09:04.834419 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:09:04.836350 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-6068d026-e647-40e6-a56b-6952512c3601 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Returning 404 to user: Instance cf38e7a7-b39a-4966-aa2d-effc83a555b8 could not be found. {{(pid=117858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 07:09:04.836350 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-6068d026-e647-40e6-a56b-6952512c3601 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "DELETE /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 404 len: 111 microversion: 2.20 time: 0.032600 Aug 09 07:09:04.836350 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 396/794] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Aug 9 07:09:04 2022] DELETE /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 07:09:04.843086 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-92433183-0fb9-42e6-a7f2-16609dd8b7a5 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:09:04.844298 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-92433183-0fb9-42e6-a7f2-16609dd8b7a5 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: cf38e7a7-b39a-4966-aa2d-effc83a555b8] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:09:04.851486 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-92433183-0fb9-42e6-a7f2-16609dd8b7a5 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:09:04.851981 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-92433183-0fb9-42e6-a7f2-16609dd8b7a5 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:09:04.852419 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-92433183-0fb9-42e6-a7f2-16609dd8b7a5 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:09:04.853144 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-92433183-0fb9-42e6-a7f2-16609dd8b7a5 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:09:04.853596 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-92433183-0fb9-42e6-a7f2-16609dd8b7a5 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:09:04.854543 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-92433183-0fb9-42e6-a7f2-16609dd8b7a5 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:09:04.868371 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-92433183-0fb9-42e6-a7f2-16609dd8b7a5 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] HTTP exception thrown: Instance cf38e7a7-b39a-4966-aa2d-effc83a555b8 could not be found. Aug 09 07:09:04.870086 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-92433183-0fb9-42e6-a7f2-16609dd8b7a5 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Request method failure captured: Aug 09 07:09:04.870086 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 HTTP/1.1 Aug 09 07:09:04.870086 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 09 07:09:04.870086 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 09 07:09:04.870086 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Connection: close Aug 09 07:09:04.870086 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Length: 0 Aug 09 07:09:04.870086 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 09 07:09:04.870086 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.30 Aug 09 07:09:04.870086 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 09 07:09:04.870086 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.11 Aug 09 07:09:04.870086 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi8gaRnSbbfLxfTalYzBSaazV26j8bqFLOBP1hFBUp7vKdmILNtFaGrVx8tLaUtHWXCdnAqpWrDgpK4RVv38wYFHwiqywSOI5IHzDHuiAQSIwLgKz7VDBMeuVzxM3n4zrHUJggy_VUwD22etwQ6V3CGPMPurPyE0ajsYjBVLVrwiTEU0M Aug 09 07:09:04.870086 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 09 07:09:04.870086 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 09 07:09:04.870086 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 09 07:09:04.870086 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 09 07:09:04.870086 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 07:09:04.870086 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 09 07:09:04.870086 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 09 07:09:04.870086 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Id: 10c7e20a9669439fa43853dab6f9851c Aug 09 07:09:04.870086 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2041815482 Aug 09 07:09:04.870086 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 09 07:09:04.870086 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 09 07:09:04.871736 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/10c7e20a9669439fa43853dab6f9851c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_10c7e20a9669439fa43853dab6f9851c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/10c7e20a9669439fa43853dab6f9851c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/10c7e20a9669439fa43853dab6f9851c"}]}] Aug 09 07:09:04.871736 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2041815482 Aug 09 07:09:04.871736 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: 10c7e20a9669439fa43853dab6f9851c Aug 09 07:09:04.871736 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2041815482 Aug 09 07:09:04.871736 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User: tempest-AttachVolumeShelveTestJSON-2041815482-project Aug 09 07:09:04.871736 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 09 07:09:04.871736 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 09 07:09:04.871736 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Id: 0bb72c5f52fc498aa60eecba3bd5248a Aug 09 07:09:04.871736 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2041815482-project Aug 09 07:09:04.871736 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: method: > Aug 09 07:09:04.871736 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: exception: Instance cf38e7a7-b39a-4966-aa2d-effc83a555b8 could not be found. Aug 09 07:09:04.871736 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: action_args: {'id': 'cf38e7a7-b39a-4966-aa2d-effc83a555b8'} Aug 09 07:09:04.872622 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 07:09:04.872622 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:09:04.872622 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 07:09:04.872622 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 07:09:04.872622 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 07:09:04.872622 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 07:09:04.872622 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 07:09:04.872622 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 07:09:04.872622 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 07:09:04.872622 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 07:09:04.872622 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf38e7a7-b39a-4966-aa2d-effc83a555b8 could not be found. Aug 09 07:09:04.872622 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:09:04.872622 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:09:04.872622 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:09:04.872622 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:09:04.872622 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:09:04.872622 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:09:04.872622 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 07:09:04.872622 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 07:09:04.872622 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 07:09:04.874105 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 07:09:04.874105 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 07:09:04.874105 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 07:09:04.874105 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 07:09:04.874105 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 07:09:04.874105 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 07:09:04.874105 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 07:09:04.874105 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf38e7a7-b39a-4966-aa2d-effc83a555b8 could not be found. Aug 09 07:09:04.874105 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:09:04.874105 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:09:04.874105 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:09:04.874105 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:09:04.874105 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:09:04.874105 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:09:04.874105 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 07:09:04.874105 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 07:09:04.874105 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf38e7a7-b39a-4966-aa2d-effc83a555b8 could not be found. Aug 09 07:09:04.874105 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:09:04.875372 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-92433183-0fb9-42e6-a7f2-16609dd8b7a5 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Returning 404 to user: Instance cf38e7a7-b39a-4966-aa2d-effc83a555b8 could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 07:09:04.875372 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-92433183-0fb9-42e6-a7f2-16609dd8b7a5 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8" status: 404 len: 111 microversion: 2.20 time: 0.034677 Aug 09 07:09:04.875372 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 399/795] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:09:04 2022] GET /compute/v2.1/servers/cf38e7a7-b39a-4966-aa2d-effc83a555b8 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 07:09:06.038164 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-a94903c1-abed-422d-ae12-c7caa7c0ad68 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:09:06.038674 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-a94903c1-abed-422d-ae12-c7caa7c0ad68 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:09:06.045129 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a94903c1-abed-422d-ae12-c7caa7c0ad68 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:09:06.045611 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a94903c1-abed-422d-ae12-c7caa7c0ad68 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:09:06.046048 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a94903c1-abed-422d-ae12-c7caa7c0ad68 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:09:06.046739 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a94903c1-abed-422d-ae12-c7caa7c0ad68 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:09:06.047188 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a94903c1-abed-422d-ae12-c7caa7c0ad68 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:09:06.047656 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a94903c1-abed-422d-ae12-c7caa7c0ad68 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:09:06.060874 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.wsgi [None req-a94903c1-abed-422d-ae12-c7caa7c0ad68 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] HTTP exception thrown: Instance 2236b6b2-39b4-4b81-bb86-006774babc2e could not be found. Aug 09 07:09:06.062399 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-a94903c1-abed-422d-ae12-c7caa7c0ad68 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Request method failure captured: Aug 09 07:09:06.062399 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: request: DELETE /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e HTTP/1.1 Aug 09 07:09:06.062399 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Accept: application/json Aug 09 07:09:06.062399 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Accept-Encoding: identity Aug 09 07:09:06.062399 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Connection: close Aug 09 07:09:06.062399 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Content-Length: 0 Aug 09 07:09:06.062399 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Content-Type: application/json Aug 09 07:09:06.062399 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Host: 10.222.0.30 Aug 09 07:09:06.062399 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Openstack-System-Scope: None Aug 09 07:09:06.062399 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: User-Agent: python-urllib3/1.26.11 Aug 09 07:09:06.062399 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Auth-Token: gAAAAABi8gaRnSbbfLxfTalYzBSaazV26j8bqFLOBP1hFBUp7vKdmILNtFaGrVx8tLaUtHWXCdnAqpWrDgpK4RVv38wYFHwiqywSOI5IHzDHuiAQSIwLgKz7VDBMeuVzxM3n4zrHUJggy_VUwD22etwQ6V3CGPMPurPyE0ajsYjBVLVrwiTEU0M Aug 09 07:09:06.062399 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Domain-Id: None Aug 09 07:09:06.062399 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Domain-Name: None Aug 09 07:09:06.062399 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Identity-Status: Confirmed Aug 09 07:09:06.062399 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Is-Admin-Project: True Aug 09 07:09:06.062399 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 07:09:06.062399 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Domain-Id: default Aug 09 07:09:06.062399 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Domain-Name: Default Aug 09 07:09:06.062399 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Id: 10c7e20a9669439fa43853dab6f9851c Aug 09 07:09:06.062399 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2041815482 Aug 09 07:09:06.062399 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Role: reader,member Aug 09 07:09:06.062399 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Roles: reader,member Aug 09 07:09:06.064234 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/10c7e20a9669439fa43853dab6f9851c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_10c7e20a9669439fa43853dab6f9851c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/10c7e20a9669439fa43853dab6f9851c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/10c7e20a9669439fa43853dab6f9851c"}]}] Aug 09 07:09:06.064234 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2041815482 Aug 09 07:09:06.064234 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant-Id: 10c7e20a9669439fa43853dab6f9851c Aug 09 07:09:06.064234 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2041815482 Aug 09 07:09:06.064234 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User: tempest-AttachVolumeShelveTestJSON-2041815482-project Aug 09 07:09:06.064234 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Domain-Id: default Aug 09 07:09:06.064234 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Domain-Name: Default Aug 09 07:09:06.064234 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Id: 0bb72c5f52fc498aa60eecba3bd5248a Aug 09 07:09:06.064234 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2041815482-project Aug 09 07:09:06.064234 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: method: > Aug 09 07:09:06.064234 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: exception: Instance 2236b6b2-39b4-4b81-bb86-006774babc2e could not be found. Aug 09 07:09:06.064234 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: action_args: {'id': '2236b6b2-39b4-4b81-bb86-006774babc2e'} Aug 09 07:09:06.065081 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 07:09:06.065081 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:09:06.065081 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 07:09:06.065081 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 07:09:06.065081 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 07:09:06.065081 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 07:09:06.065081 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 07:09:06.065081 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 07:09:06.065081 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 07:09:06.065081 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 07:09:06.065081 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2236b6b2-39b4-4b81-bb86-006774babc2e could not be found. Aug 09 07:09:06.065081 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:09:06.065081 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:09:06.065081 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:09:06.065081 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:09:06.065081 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:09:06.065081 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:09:06.065081 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 07:09:06.065081 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 07:09:06.065081 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 07:09:06.066535 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 07:09:06.066535 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 07:09:06.066535 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 07:09:06.066535 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 07:09:06.066535 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 07:09:06.066535 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 07:09:06.066535 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 07:09:06.066535 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 07:09:06.066535 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 07:09:06.066535 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2236b6b2-39b4-4b81-bb86-006774babc2e could not be found. Aug 09 07:09:06.066535 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:09:06.066535 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:09:06.066535 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:09:06.066535 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:09:06.066535 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:09:06.066535 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:09:06.066535 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 07:09:06.066535 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 07:09:06.066535 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2236b6b2-39b4-4b81-bb86-006774babc2e could not be found. Aug 09 07:09:06.066535 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:09:06.067956 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-a94903c1-abed-422d-ae12-c7caa7c0ad68 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Returning 404 to user: Instance 2236b6b2-39b4-4b81-bb86-006774babc2e could not be found. {{(pid=117858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 07:09:06.067956 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-a94903c1-abed-422d-ae12-c7caa7c0ad68 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "DELETE /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 404 len: 111 microversion: 2.20 time: 0.030152 Aug 09 07:09:06.067956 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 397/796] 10.222.0.30 () {60 vars in 1280 bytes} [Tue Aug 9 07:09:06 2022] DELETE /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 09 07:09:06.072780 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c052d82e-835c-4795-a4c6-b4930b433910 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:09:06.073382 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c052d82e-835c-4795-a4c6-b4930b433910 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] [instance: 2236b6b2-39b4-4b81-bb86-006774babc2e] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:09:06.079706 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c052d82e-835c-4795-a4c6-b4930b433910 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:09:06.080181 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c052d82e-835c-4795-a4c6-b4930b433910 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:09:06.080611 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c052d82e-835c-4795-a4c6-b4930b433910 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:09:06.081293 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c052d82e-835c-4795-a4c6-b4930b433910 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:09:06.081739 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c052d82e-835c-4795-a4c6-b4930b433910 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:09:06.082154 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c052d82e-835c-4795-a4c6-b4930b433910 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:09:06.095920 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-c052d82e-835c-4795-a4c6-b4930b433910 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] HTTP exception thrown: Instance 2236b6b2-39b4-4b81-bb86-006774babc2e could not be found. Aug 09 07:09:06.097408 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c052d82e-835c-4795-a4c6-b4930b433910 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Request method failure captured: Aug 09 07:09:06.097408 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e HTTP/1.1 Aug 09 07:09:06.097408 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 09 07:09:06.097408 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 09 07:09:06.097408 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Connection: close Aug 09 07:09:06.097408 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Length: 0 Aug 09 07:09:06.097408 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 09 07:09:06.097408 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.30 Aug 09 07:09:06.097408 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 09 07:09:06.097408 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.11 Aug 09 07:09:06.097408 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi8gaRnSbbfLxfTalYzBSaazV26j8bqFLOBP1hFBUp7vKdmILNtFaGrVx8tLaUtHWXCdnAqpWrDgpK4RVv38wYFHwiqywSOI5IHzDHuiAQSIwLgKz7VDBMeuVzxM3n4zrHUJggy_VUwD22etwQ6V3CGPMPurPyE0ajsYjBVLVrwiTEU0M Aug 09 07:09:06.097408 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 09 07:09:06.097408 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 09 07:09:06.097408 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 09 07:09:06.097408 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 09 07:09:06.097408 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Openstack-Nova-Api-Version: 2.20 Aug 09 07:09:06.097408 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 09 07:09:06.097408 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 09 07:09:06.097408 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Id: 10c7e20a9669439fa43853dab6f9851c Aug 09 07:09:06.097408 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2041815482 Aug 09 07:09:06.097408 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 09 07:09:06.097408 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 09 07:09:06.099093 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/10c7e20a9669439fa43853dab6f9851c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_10c7e20a9669439fa43853dab6f9851c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/10c7e20a9669439fa43853dab6f9851c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/10c7e20a9669439fa43853dab6f9851c"}]}] Aug 09 07:09:06.099093 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2041815482 Aug 09 07:09:06.099093 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: 10c7e20a9669439fa43853dab6f9851c Aug 09 07:09:06.099093 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2041815482 Aug 09 07:09:06.099093 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User: tempest-AttachVolumeShelveTestJSON-2041815482-project Aug 09 07:09:06.099093 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 09 07:09:06.099093 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 09 07:09:06.099093 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Id: 0bb72c5f52fc498aa60eecba3bd5248a Aug 09 07:09:06.099093 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2041815482-project Aug 09 07:09:06.099093 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: method: > Aug 09 07:09:06.099093 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: exception: Instance 2236b6b2-39b4-4b81-bb86-006774babc2e could not be found. Aug 09 07:09:06.099093 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: action_args: {'id': '2236b6b2-39b4-4b81-bb86-006774babc2e'} Aug 09 07:09:06.100004 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 07:09:06.100004 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:09:06.100004 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 07:09:06.100004 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 07:09:06.100004 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 07:09:06.100004 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 07:09:06.100004 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 07:09:06.100004 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 07:09:06.100004 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 07:09:06.100004 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 07:09:06.100004 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2236b6b2-39b4-4b81-bb86-006774babc2e could not be found. Aug 09 07:09:06.100004 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:09:06.100004 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:09:06.100004 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:09:06.100004 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:09:06.100004 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:09:06.100004 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:09:06.100004 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 07:09:06.100004 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 07:09:06.100004 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 07:09:06.101203 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 07:09:06.101203 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 07:09:06.101203 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 07:09:06.101203 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 07:09:06.101203 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 07:09:06.101203 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 07:09:06.101203 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 07:09:06.101203 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2236b6b2-39b4-4b81-bb86-006774babc2e could not be found. Aug 09 07:09:06.101203 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:09:06.101203 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:09:06.101203 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:09:06.101203 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:09:06.101203 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:09:06.101203 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:09:06.101203 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 07:09:06.101203 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 07:09:06.101203 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2236b6b2-39b4-4b81-bb86-006774babc2e could not be found. Aug 09 07:09:06.101203 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:09:06.102272 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c052d82e-835c-4795-a4c6-b4930b433910 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] Returning 404 to user: Instance 2236b6b2-39b4-4b81-bb86-006774babc2e could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 07:09:06.102272 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c052d82e-835c-4795-a4c6-b4930b433910 tempest-AttachVolumeShelveTestJSON-2041815482 tempest-AttachVolumeShelveTestJSON-2041815482-project] 10.222.0.30 "GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e" status: 404 len: 111 microversion: 2.20 time: 0.030072 Aug 09 07:09:06.102272 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 400/797] 10.222.0.30 () {60 vars in 1277 bytes} [Tue Aug 9 07:09:06 2022] GET /compute/v2.1/servers/2236b6b2-39b4-4b81-bb86-006774babc2e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 09 07:09:37.184095 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-282e1938-7bfb-4f8a-a0a3-63967517aaed tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Action: 'create', calling method: .version_select at 0x7f20ddbfc940>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-225926961", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDTcWY4R1ji/zyoSDBGp5JtgqeSI/1IX4fYx9qDZwhhjkJLePooqfeVjKlBZHwyOqnyA6L7+DHJYHma9+sP1DpnjlNGtcnee2AB8oRP53Q9COIA83tkUlrPw4z7EkNZlAw=="}} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:09:37.189604 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_api:SELECT=12 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:37.190438 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_cell1:SELECT=20 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:37.202596 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.quota [None req-282e1938-7bfb-4f8a-a0a3-63967517aaed tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Getting quotas for project 272a737decfd4dba9538dffbc7c1db5b. Resources: {'key_pairs'} {{(pid=117858) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 07:09:37.206388 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.quota [None req-282e1938-7bfb-4f8a-a0a3-63967517aaed tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Getting quotas for user 97ab9c24c5404e1892bb44b09be583fe and project 272a737decfd4dba9538dffbc7c1db5b. Resources: {'key_pairs'} {{(pid=117858) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 07:09:37.227883 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-282e1938-7bfb-4f8a-a0a3-63967517aaed tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.048256 Aug 09 07:09:37.228464 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 398/798] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 9 07:09:37 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:09:37.332738 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f54efc3e-b6eb-4145-9f05-2d3b2005b125 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1715854490", "imageRef": "ec57bdb3-81c3-4ecc-a0c2-89466ce3019e", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-225926961", "networks": [{"uuid": "8264b026-786c-4701-80ac-8b11580c9934"}]}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:09:37.341433 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:37.342093 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:37.390223 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.network.neutron [None req-f54efc3e-b6eb-4145-9f05-2d3b2005b125 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] validate_networks() for [('8264b026-786c-4701-80ac-8b11580c9934', None, None, None, None, None)] {{(pid=117859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 07:09:37.847067 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-f54efc3e-b6eb-4145-9f05-2d3b2005b125 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Flavor limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 07:09:37.847491 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-f54efc3e-b6eb-4145-9f05-2d3b2005b125 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Image limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 07:09:37.847999 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-f54efc3e-b6eb-4145-9f05-2d3b2005b125 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Flavor pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 07:09:37.848409 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-f54efc3e-b6eb-4145-9f05-2d3b2005b125 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Image pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 07:09:37.848823 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-f54efc3e-b6eb-4145-9f05-2d3b2005b125 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 07:09:37.858475 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f54efc3e-b6eb-4145-9f05-2d3b2005b125 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:09:37.858963 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f54efc3e-b6eb-4145-9f05-2d3b2005b125 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:09:37.859399 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f54efc3e-b6eb-4145-9f05-2d3b2005b125 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:09:37.860164 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f54efc3e-b6eb-4145-9f05-2d3b2005b125 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:09:37.860622 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f54efc3e-b6eb-4145-9f05-2d3b2005b125 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:09:37.861057 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f54efc3e-b6eb-4145-9f05-2d3b2005b125 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:09:37.878174 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-f54efc3e-b6eb-4145-9f05-2d3b2005b125 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Getting quotas for project 272a737decfd4dba9538dffbc7c1db5b. Resources: {'cores', 'instances', 'ram'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 07:09:37.882116 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-f54efc3e-b6eb-4145-9f05-2d3b2005b125 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Getting quotas for user 97ab9c24c5404e1892bb44b09be583fe and project 272a737decfd4dba9538dffbc7c1db5b. Resources: {'cores', 'instances', 'ram'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 07:09:37.893642 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-f54efc3e-b6eb-4145-9f05-2d3b2005b125 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Going to run 1 instances... {{(pid=117859) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 07:09:37.895854 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-f54efc3e-b6eb-4145-9f05-2d3b2005b125 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] [instance: b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ec57bdb3-81c3-4ecc-a0c2-89466ce3019e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 07:09:37.940922 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f54efc3e-b6eb-4145-9f05-2d3b2005b125 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.611977 Aug 09 07:09:37.946362 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 401/799] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 9 07:09:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 07:09:37.952796 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-31b156fe-c3c2-42e8-a893-7c6efe28d295 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:09:37.953521 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-31b156fe-c3c2-42e8-a893-7c6efe28d295 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] [instance: b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:09:38.010166 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-31b156fe-c3c2-42e8-a893-7c6efe28d295 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ab9c24c5404e1892bb44b09be583fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272a737decfd4dba9538dffbc7c1db5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:09:38.020228 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-31b156fe-c3c2-42e8-a893-7c6efe28d295 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] 10.222.0.30 "GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd" status: 200 len: 1258 microversion: 2.1 time: 0.071064 Aug 09 07:09:38.020934 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 399/800] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:09:37 2022] GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd => generated 1258 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:09:39.041867 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-990482bf-5457-44ec-9c2f-bc6dc918b7e1 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:09:39.042476 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-990482bf-5457-44ec-9c2f-bc6dc918b7e1 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] [instance: b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:09:39.049630 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-990482bf-5457-44ec-9c2f-bc6dc918b7e1 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:09:39.050112 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-990482bf-5457-44ec-9c2f-bc6dc918b7e1 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:09:39.050542 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-990482bf-5457-44ec-9c2f-bc6dc918b7e1 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:09:39.051225 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-990482bf-5457-44ec-9c2f-bc6dc918b7e1 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:09:39.051705 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-990482bf-5457-44ec-9c2f-bc6dc918b7e1 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:09:39.052130 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-990482bf-5457-44ec-9c2f-bc6dc918b7e1 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:09:39.117920 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-990482bf-5457-44ec-9c2f-bc6dc918b7e1 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ab9c24c5404e1892bb44b09be583fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272a737decfd4dba9538dffbc7c1db5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:09:39.125373 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-990482bf-5457-44ec-9c2f-bc6dc918b7e1 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] 10.222.0.30 "GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd" status: 200 len: 1310 microversion: 2.1 time: 0.087729 Aug 09 07:09:39.126140 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 402/801] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:09:39 2022] GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd => generated 1310 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:09:40.147932 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-4d60d554-7090-4273-83fc-acc9e8586356 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:09:40.149343 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-4d60d554-7090-4273-83fc-acc9e8586356 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] [instance: b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:09:40.164104 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4d60d554-7090-4273-83fc-acc9e8586356 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:09:40.164889 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4d60d554-7090-4273-83fc-acc9e8586356 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:09:40.165509 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4d60d554-7090-4273-83fc-acc9e8586356 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:09:40.166395 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4d60d554-7090-4273-83fc-acc9e8586356 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:09:40.168837 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4d60d554-7090-4273-83fc-acc9e8586356 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:09:40.169452 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4d60d554-7090-4273-83fc-acc9e8586356 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:09:40.404266 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-4d60d554-7090-4273-83fc-acc9e8586356 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ab9c24c5404e1892bb44b09be583fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272a737decfd4dba9538dffbc7c1db5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:09:40.412967 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-4d60d554-7090-4273-83fc-acc9e8586356 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] 10.222.0.30 "GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd" status: 200 len: 1358 microversion: 2.1 time: 0.269253 Aug 09 07:09:40.421599 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 400/802] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:09:40 2022] GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd => generated 1358 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:09:41.439257 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-3ab1f8bf-6b28-4926-a06d-83bbccb03010 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:09:41.440417 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-3ab1f8bf-6b28-4926-a06d-83bbccb03010 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] [instance: b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:09:41.459671 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3ab1f8bf-6b28-4926-a06d-83bbccb03010 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:09:41.461502 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3ab1f8bf-6b28-4926-a06d-83bbccb03010 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:09:41.468866 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3ab1f8bf-6b28-4926-a06d-83bbccb03010 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:09:41.469984 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3ab1f8bf-6b28-4926-a06d-83bbccb03010 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:09:41.471004 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3ab1f8bf-6b28-4926-a06d-83bbccb03010 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:09:41.471210 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3ab1f8bf-6b28-4926-a06d-83bbccb03010 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:09:41.687520 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-3ab1f8bf-6b28-4926-a06d-83bbccb03010 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ab9c24c5404e1892bb44b09be583fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272a737decfd4dba9538dffbc7c1db5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:09:41.697326 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-3ab1f8bf-6b28-4926-a06d-83bbccb03010 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] 10.222.0.30 "GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd" status: 200 len: 1358 microversion: 2.1 time: 0.262859 Aug 09 07:09:41.699553 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 403/803] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:09:41 2022] GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd => generated 1358 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:09:42.720991 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-3b9a78b6-c3d3-4e7d-8bd0-07a3a0c53c93 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:09:42.726898 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-3b9a78b6-c3d3-4e7d-8bd0-07a3a0c53c93 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] [instance: b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:09:42.728556 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3b9a78b6-c3d3-4e7d-8bd0-07a3a0c53c93 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:09:42.729044 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3b9a78b6-c3d3-4e7d-8bd0-07a3a0c53c93 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:09:42.729482 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3b9a78b6-c3d3-4e7d-8bd0-07a3a0c53c93 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:09:42.730178 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3b9a78b6-c3d3-4e7d-8bd0-07a3a0c53c93 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:09:42.730634 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3b9a78b6-c3d3-4e7d-8bd0-07a3a0c53c93 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:09:42.731062 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3b9a78b6-c3d3-4e7d-8bd0-07a3a0c53c93 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:09:42.909554 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-3b9a78b6-c3d3-4e7d-8bd0-07a3a0c53c93 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ab9c24c5404e1892bb44b09be583fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272a737decfd4dba9538dffbc7c1db5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:09:42.917932 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-3b9a78b6-c3d3-4e7d-8bd0-07a3a0c53c93 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] 10.222.0.30 "GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd" status: 200 len: 1358 microversion: 2.1 time: 0.200729 Aug 09 07:09:42.918785 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 401/804] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:09:42 2022] GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd => generated 1358 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:09:43.940232 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-422e9e83-77a9-46ed-b8e7-2d724d2f9310 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:09:43.941533 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-422e9e83-77a9-46ed-b8e7-2d724d2f9310 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] [instance: b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:09:43.948980 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-422e9e83-77a9-46ed-b8e7-2d724d2f9310 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:09:43.949951 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-422e9e83-77a9-46ed-b8e7-2d724d2f9310 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:09:43.950645 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-422e9e83-77a9-46ed-b8e7-2d724d2f9310 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:09:43.951576 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-422e9e83-77a9-46ed-b8e7-2d724d2f9310 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:09:43.952310 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-422e9e83-77a9-46ed-b8e7-2d724d2f9310 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:09:43.952954 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-422e9e83-77a9-46ed-b8e7-2d724d2f9310 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:09:44.093101 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-422e9e83-77a9-46ed-b8e7-2d724d2f9310 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ab9c24c5404e1892bb44b09be583fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272a737decfd4dba9538dffbc7c1db5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:09:44.102296 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-422e9e83-77a9-46ed-b8e7-2d724d2f9310 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] 10.222.0.30 "GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd" status: 200 len: 1358 microversion: 2.1 time: 0.164667 Aug 09 07:09:44.102797 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 404/805] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:09:43 2022] GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:09:45.123276 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-8cdb864f-ca1e-4aab-8b78-6cb0751ecd5e tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:09:45.124073 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-8cdb864f-ca1e-4aab-8b78-6cb0751ecd5e tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] [instance: b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:09:45.130848 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-8cdb864f-ca1e-4aab-8b78-6cb0751ecd5e tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:09:45.131325 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-8cdb864f-ca1e-4aab-8b78-6cb0751ecd5e tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:09:45.131790 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-8cdb864f-ca1e-4aab-8b78-6cb0751ecd5e tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:09:45.132535 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-8cdb864f-ca1e-4aab-8b78-6cb0751ecd5e tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:09:45.132988 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-8cdb864f-ca1e-4aab-8b78-6cb0751ecd5e tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:09:45.133412 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-8cdb864f-ca1e-4aab-8b78-6cb0751ecd5e tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:09:45.279963 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-8cdb864f-ca1e-4aab-8b78-6cb0751ecd5e tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ab9c24c5404e1892bb44b09be583fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272a737decfd4dba9538dffbc7c1db5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:09:45.287893 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-8cdb864f-ca1e-4aab-8b78-6cb0751ecd5e tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] 10.222.0.30 "GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd" status: 200 len: 1358 microversion: 2.1 time: 0.168484 Aug 09 07:09:45.301075 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 402/806] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:09:45 2022] GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:09:46.309669 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c19a9a14-8803-4189-b9ad-edf025b96e2d tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:09:46.310319 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c19a9a14-8803-4189-b9ad-edf025b96e2d tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] [instance: b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:09:46.316604 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c19a9a14-8803-4189-b9ad-edf025b96e2d tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:09:46.317092 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c19a9a14-8803-4189-b9ad-edf025b96e2d tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:09:46.317533 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c19a9a14-8803-4189-b9ad-edf025b96e2d tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:09:46.318235 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c19a9a14-8803-4189-b9ad-edf025b96e2d tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:09:46.318693 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c19a9a14-8803-4189-b9ad-edf025b96e2d tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:09:46.319123 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c19a9a14-8803-4189-b9ad-edf025b96e2d tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:09:46.505694 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c19a9a14-8803-4189-b9ad-edf025b96e2d tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ab9c24c5404e1892bb44b09be583fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272a737decfd4dba9538dffbc7c1db5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:09:46.515667 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c19a9a14-8803-4189-b9ad-edf025b96e2d tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] 10.222.0.30 "GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd" status: 200 len: 1358 microversion: 2.1 time: 0.209712 Aug 09 07:09:46.516504 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 405/807] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:09:46 2022] GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd => generated 1358 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:09:47.537699 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-d1643016-8931-4ad3-8bc8-7c2740d2c95a tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:09:47.538853 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-d1643016-8931-4ad3-8bc8-7c2740d2c95a tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] [instance: b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:09:47.545650 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d1643016-8931-4ad3-8bc8-7c2740d2c95a tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:09:47.546144 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d1643016-8931-4ad3-8bc8-7c2740d2c95a tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:09:47.546583 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d1643016-8931-4ad3-8bc8-7c2740d2c95a tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:09:47.547298 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d1643016-8931-4ad3-8bc8-7c2740d2c95a tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:09:47.547769 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d1643016-8931-4ad3-8bc8-7c2740d2c95a tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:09:47.548194 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d1643016-8931-4ad3-8bc8-7c2740d2c95a tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:09:47.694732 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-d1643016-8931-4ad3-8bc8-7c2740d2c95a tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ab9c24c5404e1892bb44b09be583fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272a737decfd4dba9538dffbc7c1db5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:09:47.703074 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-d1643016-8931-4ad3-8bc8-7c2740d2c95a tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] 10.222.0.30 "GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd" status: 200 len: 1358 microversion: 2.1 time: 0.169461 Aug 09 07:09:47.703706 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 403/808] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:09:47 2022] GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:09:48.723246 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a4244871-8df6-4544-aee9-a3138321c8a5 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:09:48.724082 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-a4244871-8df6-4544-aee9-a3138321c8a5 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] [instance: b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:09:48.727114 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=2 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:48.728145 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=6 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:48.734454 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a4244871-8df6-4544-aee9-a3138321c8a5 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:09:48.734945 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a4244871-8df6-4544-aee9-a3138321c8a5 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:09:48.735382 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a4244871-8df6-4544-aee9-a3138321c8a5 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:09:48.736120 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a4244871-8df6-4544-aee9-a3138321c8a5 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:09:48.736591 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a4244871-8df6-4544-aee9-a3138321c8a5 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:09:48.737012 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a4244871-8df6-4544-aee9-a3138321c8a5 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:09:48.876234 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-a4244871-8df6-4544-aee9-a3138321c8a5 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ab9c24c5404e1892bb44b09be583fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272a737decfd4dba9538dffbc7c1db5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:09:48.884725 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-a4244871-8df6-4544-aee9-a3138321c8a5 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] 10.222.0.30 "GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd" status: 200 len: 1358 microversion: 2.1 time: 0.165503 Aug 09 07:09:48.885288 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 406/809] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:09:48 2022] GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:09:49.906164 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-4ab23033-219f-41d6-b535-31df61c28ff9 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:09:49.906734 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-4ab23033-219f-41d6-b535-31df61c28ff9 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] [instance: b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:09:49.908549 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_cell0:SELECT=6 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:09:49.915454 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4ab23033-219f-41d6-b535-31df61c28ff9 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:09:49.915961 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4ab23033-219f-41d6-b535-31df61c28ff9 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:09:49.916397 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4ab23033-219f-41d6-b535-31df61c28ff9 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:09:49.917087 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4ab23033-219f-41d6-b535-31df61c28ff9 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:09:49.917539 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4ab23033-219f-41d6-b535-31df61c28ff9 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:09:49.917964 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4ab23033-219f-41d6-b535-31df61c28ff9 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:09:50.053364 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-4ab23033-219f-41d6-b535-31df61c28ff9 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ab9c24c5404e1892bb44b09be583fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272a737decfd4dba9538dffbc7c1db5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:09:50.062406 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-4ab23033-219f-41d6-b535-31df61c28ff9 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] 10.222.0.30 "GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd" status: 200 len: 1358 microversion: 2.1 time: 0.160055 Aug 09 07:09:50.063189 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 404/810] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:09:49 2022] GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:09:50.586418 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-589ad125-29e8-4c14-a130-b7fe6e3a401b req-1e036d87-09a3-4636-b92c-6a60e359693d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd", "tag": "6bc82b3c-3c4d-4507-9829-44df16ea5af8"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:09:50.596919 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-589ad125-29e8-4c14-a130-b7fe6e3a401b req-1e036d87-09a3-4636-b92c-6a60e359693d service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:09:50.597581 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-589ad125-29e8-4c14-a130-b7fe6e3a401b req-1e036d87-09a3-4636-b92c-6a60e359693d service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:09:50.598121 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-589ad125-29e8-4c14-a130-b7fe6e3a401b req-1e036d87-09a3-4636-b92c-6a60e359693d service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:09:50.611195 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-589ad125-29e8-4c14-a130-b7fe6e3a401b req-1e036d87-09a3-4636-b92c-6a60e359693d service nova] Creating event network-changed:6bc82b3c-3c4d-4507-9829-44df16ea5af8 for instance b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd on hv-cinder-85251 Aug 09 07:09:50.616010 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-589ad125-29e8-4c14-a130-b7fe6e3a401b req-1e036d87-09a3-4636-b92c-6a60e359693d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033417 Aug 09 07:09:50.617189 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 407/811] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:09:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 07:09:51.084481 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-11ea131b-1675-4512-bce0-71479063b90e tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:09:51.085596 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-11ea131b-1675-4512-bce0-71479063b90e tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] [instance: b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:09:51.093587 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-11ea131b-1675-4512-bce0-71479063b90e tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:09:51.094001 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-11ea131b-1675-4512-bce0-71479063b90e tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:09:51.094441 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-11ea131b-1675-4512-bce0-71479063b90e tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:09:51.095134 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-11ea131b-1675-4512-bce0-71479063b90e tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:09:51.095581 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-11ea131b-1675-4512-bce0-71479063b90e tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:09:51.096024 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-11ea131b-1675-4512-bce0-71479063b90e tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:09:51.229875 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-11ea131b-1675-4512-bce0-71479063b90e tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ab9c24c5404e1892bb44b09be583fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272a737decfd4dba9538dffbc7c1db5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:09:51.237283 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-11ea131b-1675-4512-bce0-71479063b90e tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] 10.222.0.30 "GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd" status: 200 len: 1358 microversion: 2.1 time: 0.156939 Aug 09 07:09:51.238154 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 405/812] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:09:51 2022] GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:09:52.260003 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-0b689e86-5628-4f55-b91e-f947835dbfd5 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:09:52.260599 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-0b689e86-5628-4f55-b91e-f947835dbfd5 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] [instance: b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:09:52.266931 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0b689e86-5628-4f55-b91e-f947835dbfd5 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:09:52.267416 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0b689e86-5628-4f55-b91e-f947835dbfd5 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:09:52.267890 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0b689e86-5628-4f55-b91e-f947835dbfd5 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:09:52.268614 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0b689e86-5628-4f55-b91e-f947835dbfd5 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:09:52.269066 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0b689e86-5628-4f55-b91e-f947835dbfd5 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:09:52.269491 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0b689e86-5628-4f55-b91e-f947835dbfd5 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:09:52.397952 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-0b689e86-5628-4f55-b91e-f947835dbfd5 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ab9c24c5404e1892bb44b09be583fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272a737decfd4dba9538dffbc7c1db5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:09:52.405428 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-0b689e86-5628-4f55-b91e-f947835dbfd5 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] 10.222.0.30 "GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd" status: 200 len: 1358 microversion: 2.1 time: 0.150713 Aug 09 07:09:52.405986 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 408/813] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:09:52 2022] GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:09:53.426354 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-56cc9136-4d9e-4209-bbbd-f1211c270c42 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:09:53.426971 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-56cc9136-4d9e-4209-bbbd-f1211c270c42 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] [instance: b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:09:53.433549 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-56cc9136-4d9e-4209-bbbd-f1211c270c42 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:09:53.434030 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-56cc9136-4d9e-4209-bbbd-f1211c270c42 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:09:53.434465 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-56cc9136-4d9e-4209-bbbd-f1211c270c42 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:09:53.435149 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-56cc9136-4d9e-4209-bbbd-f1211c270c42 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:09:53.435618 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-56cc9136-4d9e-4209-bbbd-f1211c270c42 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:09:53.436080 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-56cc9136-4d9e-4209-bbbd-f1211c270c42 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:09:53.568453 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-56cc9136-4d9e-4209-bbbd-f1211c270c42 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ab9c24c5404e1892bb44b09be583fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272a737decfd4dba9538dffbc7c1db5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:09:53.576277 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-56cc9136-4d9e-4209-bbbd-f1211c270c42 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] 10.222.0.30 "GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd" status: 200 len: 1358 microversion: 2.1 time: 0.154016 Aug 09 07:09:53.576833 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 406/814] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:09:53 2022] GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:09:54.598281 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-981a9136-0c6f-4685-825f-33a33c2eaa8b tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:09:54.598809 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-981a9136-0c6f-4685-825f-33a33c2eaa8b tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] [instance: b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:09:54.605851 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-981a9136-0c6f-4685-825f-33a33c2eaa8b tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:09:54.606331 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-981a9136-0c6f-4685-825f-33a33c2eaa8b tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:09:54.606764 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-981a9136-0c6f-4685-825f-33a33c2eaa8b tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:09:54.607450 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-981a9136-0c6f-4685-825f-33a33c2eaa8b tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:09:54.607934 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-981a9136-0c6f-4685-825f-33a33c2eaa8b tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:09:54.608358 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-981a9136-0c6f-4685-825f-33a33c2eaa8b tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:09:54.736328 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-981a9136-0c6f-4685-825f-33a33c2eaa8b tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ab9c24c5404e1892bb44b09be583fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272a737decfd4dba9538dffbc7c1db5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:09:54.743607 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-981a9136-0c6f-4685-825f-33a33c2eaa8b tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] 10.222.0.30 "GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd" status: 200 len: 1358 microversion: 2.1 time: 0.149267 Aug 09 07:09:54.744184 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 409/815] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:09:54 2022] GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:09:55.765117 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-b70a0f65-a14e-4adc-8b25-9b598e303226 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:09:55.765725 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-b70a0f65-a14e-4adc-8b25-9b598e303226 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] [instance: b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:09:55.772039 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b70a0f65-a14e-4adc-8b25-9b598e303226 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:09:55.772515 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b70a0f65-a14e-4adc-8b25-9b598e303226 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:09:55.772950 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b70a0f65-a14e-4adc-8b25-9b598e303226 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:09:55.773628 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b70a0f65-a14e-4adc-8b25-9b598e303226 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:09:55.774661 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b70a0f65-a14e-4adc-8b25-9b598e303226 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:09:55.775089 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b70a0f65-a14e-4adc-8b25-9b598e303226 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:09:55.902303 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-b70a0f65-a14e-4adc-8b25-9b598e303226 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ab9c24c5404e1892bb44b09be583fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272a737decfd4dba9538dffbc7c1db5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:09:55.909622 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-b70a0f65-a14e-4adc-8b25-9b598e303226 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] 10.222.0.30 "GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd" status: 200 len: 1358 microversion: 2.1 time: 0.148376 Aug 09 07:09:55.910188 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 407/816] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:09:55 2022] GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:09:56.930318 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-07b73d4d-d30c-4aff-bd9d-454a7746cfb4 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:09:56.931053 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-07b73d4d-d30c-4aff-bd9d-454a7746cfb4 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] [instance: b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:09:56.937098 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-07b73d4d-d30c-4aff-bd9d-454a7746cfb4 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:09:56.937571 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-07b73d4d-d30c-4aff-bd9d-454a7746cfb4 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:09:56.937997 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-07b73d4d-d30c-4aff-bd9d-454a7746cfb4 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:09:56.938677 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-07b73d4d-d30c-4aff-bd9d-454a7746cfb4 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:09:56.939121 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-07b73d4d-d30c-4aff-bd9d-454a7746cfb4 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:09:56.939534 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-07b73d4d-d30c-4aff-bd9d-454a7746cfb4 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:09:57.069227 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-07b73d4d-d30c-4aff-bd9d-454a7746cfb4 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ab9c24c5404e1892bb44b09be583fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272a737decfd4dba9538dffbc7c1db5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:09:57.076696 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-07b73d4d-d30c-4aff-bd9d-454a7746cfb4 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] 10.222.0.30 "GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd" status: 200 len: 1358 microversion: 2.1 time: 0.150351 Aug 09 07:09:57.077256 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 410/817] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:09:56 2022] GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:09:58.098491 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-603f0a46-f051-4640-93ce-319e0df7b6b7 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:09:58.099130 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-603f0a46-f051-4640-93ce-319e0df7b6b7 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] [instance: b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:09:58.107055 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-603f0a46-f051-4640-93ce-319e0df7b6b7 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:09:58.107577 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-603f0a46-f051-4640-93ce-319e0df7b6b7 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:09:58.107998 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-603f0a46-f051-4640-93ce-319e0df7b6b7 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:09:58.108819 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-603f0a46-f051-4640-93ce-319e0df7b6b7 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:09:58.109274 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-603f0a46-f051-4640-93ce-319e0df7b6b7 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:09:58.109698 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-603f0a46-f051-4640-93ce-319e0df7b6b7 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:09:58.269272 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-603f0a46-f051-4640-93ce-319e0df7b6b7 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ab9c24c5404e1892bb44b09be583fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272a737decfd4dba9538dffbc7c1db5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:09:58.281288 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-603f0a46-f051-4640-93ce-319e0df7b6b7 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] 10.222.0.30 "GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd" status: 200 len: 1358 microversion: 2.1 time: 0.186962 Aug 09 07:09:58.281854 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 408/818] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:09:58 2022] GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:09:58.379667 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-d27da6ad-7d58-46ff-a64f-202ad5522ec1 req-d8873d33-ee48-482a-8b07-1a94a2032aef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd", "name": "network-vif-plugged", "status": "completed", "tag": "6bc82b3c-3c4d-4507-9829-44df16ea5af8"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:09:58.391908 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-d27da6ad-7d58-46ff-a64f-202ad5522ec1 req-d8873d33-ee48-482a-8b07-1a94a2032aef service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:09:58.392800 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-d27da6ad-7d58-46ff-a64f-202ad5522ec1 req-d8873d33-ee48-482a-8b07-1a94a2032aef service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:09:58.393300 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-d27da6ad-7d58-46ff-a64f-202ad5522ec1 req-d8873d33-ee48-482a-8b07-1a94a2032aef service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:09:58.407938 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-d27da6ad-7d58-46ff-a64f-202ad5522ec1 req-d8873d33-ee48-482a-8b07-1a94a2032aef service nova] Creating event network-vif-plugged:6bc82b3c-3c4d-4507-9829-44df16ea5af8 for instance b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd on hv-cinder-85251 Aug 09 07:09:58.413318 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-d27da6ad-7d58-46ff-a64f-202ad5522ec1 req-d8873d33-ee48-482a-8b07-1a94a2032aef service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038166 Aug 09 07:09:58.414869 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 411/819] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:09:59.302247 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-045282e4-6b2d-4fd3-8fb2-68a23b3e524f tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:09:59.302841 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-045282e4-6b2d-4fd3-8fb2-68a23b3e524f tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] [instance: b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:09:59.309614 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-045282e4-6b2d-4fd3-8fb2-68a23b3e524f tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:09:59.310084 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-045282e4-6b2d-4fd3-8fb2-68a23b3e524f tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:09:59.310524 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-045282e4-6b2d-4fd3-8fb2-68a23b3e524f tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:09:59.311191 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-045282e4-6b2d-4fd3-8fb2-68a23b3e524f tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:09:59.311661 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-045282e4-6b2d-4fd3-8fb2-68a23b3e524f tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:09:59.312081 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-045282e4-6b2d-4fd3-8fb2-68a23b3e524f tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:09:59.443448 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-045282e4-6b2d-4fd3-8fb2-68a23b3e524f tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ab9c24c5404e1892bb44b09be583fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272a737decfd4dba9538dffbc7c1db5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:09:59.451455 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-045282e4-6b2d-4fd3-8fb2-68a23b3e524f tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] 10.222.0.30 "GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd" status: 200 len: 1358 microversion: 2.1 time: 0.153039 Aug 09 07:09:59.452111 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 409/820] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:09:59 2022] GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:10:00.473490 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-bc39ae93-3b30-4b4b-92ec-83de3bf4dfca tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:10:00.474260 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-bc39ae93-3b30-4b4b-92ec-83de3bf4dfca tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] [instance: b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:10:00.481120 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bc39ae93-3b30-4b4b-92ec-83de3bf4dfca tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:00.481614 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bc39ae93-3b30-4b4b-92ec-83de3bf4dfca tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:00.482027 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bc39ae93-3b30-4b4b-92ec-83de3bf4dfca tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:00.482714 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bc39ae93-3b30-4b4b-92ec-83de3bf4dfca tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:00.483134 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bc39ae93-3b30-4b4b-92ec-83de3bf4dfca tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:00.483550 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bc39ae93-3b30-4b4b-92ec-83de3bf4dfca tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:00.633761 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-bc39ae93-3b30-4b4b-92ec-83de3bf4dfca tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ab9c24c5404e1892bb44b09be583fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272a737decfd4dba9538dffbc7c1db5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:10:00.641944 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-bc39ae93-3b30-4b4b-92ec-83de3bf4dfca tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] 10.222.0.30 "GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd" status: 200 len: 1549 microversion: 2.1 time: 0.173226 Aug 09 07:10:00.642765 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 412/821] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:10:00 2022] GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd => generated 1549 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:10:00.666298 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-34285e30-2052-455a-aa37-c9c195a49733 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:10:00.666924 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-34285e30-2052-455a-aa37-c9c195a49733 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] [instance: b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:10:00.673504 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-34285e30-2052-455a-aa37-c9c195a49733 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:00.674161 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-34285e30-2052-455a-aa37-c9c195a49733 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:00.674667 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-34285e30-2052-455a-aa37-c9c195a49733 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:00.675526 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-34285e30-2052-455a-aa37-c9c195a49733 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:00.676194 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-34285e30-2052-455a-aa37-c9c195a49733 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:00.676613 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-34285e30-2052-455a-aa37-c9c195a49733 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:00.825136 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-34285e30-2052-455a-aa37-c9c195a49733 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ab9c24c5404e1892bb44b09be583fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272a737decfd4dba9538dffbc7c1db5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:10:00.832816 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-34285e30-2052-455a-aa37-c9c195a49733 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] 10.222.0.30 "GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd" status: 200 len: 1549 microversion: 2.1 time: 0.171254 Aug 09 07:10:00.833386 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 410/822] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:10:00 2022] GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd => generated 1549 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:10:00.856864 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-8b46c5ed-0829-4254-89ea-3018e06524ba tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:10:00.861783 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8b46c5ed-0829-4254-89ea-3018e06524ba tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '97ab9c24c5404e1892bb44b09be583fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272a737decfd4dba9538dffbc7c1db5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:10:00.862547 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-8b46c5ed-0829-4254-89ea-3018e06524ba tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Searching by: {'deleted': False, 'project_id': '272a737decfd4dba9538dffbc7c1db5b'} {{(pid=117859) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 09 07:10:00.869275 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8b46c5ed-0829-4254-89ea-3018e06524ba tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:00.869749 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8b46c5ed-0829-4254-89ea-3018e06524ba tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:00.870184 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8b46c5ed-0829-4254-89ea-3018e06524ba tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:00.870902 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8b46c5ed-0829-4254-89ea-3018e06524ba tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:00.871351 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8b46c5ed-0829-4254-89ea-3018e06524ba tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:00.871802 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8b46c5ed-0829-4254-89ea-3018e06524ba tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:00.959014 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.multi_cell_list [None req-8b46c5ed-0829-4254-89ea-3018e06524ba tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117859) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 09 07:10:01.056584 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-8b46c5ed-0829-4254-89ea-3018e06524ba tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] 10.222.0.30 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.206332 Aug 09 07:10:01.057089 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 413/823] 10.222.0.30 () {58 vars in 1125 bytes} [Tue Aug 9 07:10:00 2022] GET /compute/v2.1/servers => generated 343 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:10:01.068287 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-31acbeac-f42f-4113-b54d-52dab851c223 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:10:01.068901 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-31acbeac-f42f-4113-b54d-52dab851c223 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] [instance: b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:10:01.075357 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-31acbeac-f42f-4113-b54d-52dab851c223 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:01.075869 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-31acbeac-f42f-4113-b54d-52dab851c223 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:01.076301 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-31acbeac-f42f-4113-b54d-52dab851c223 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:01.076984 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-31acbeac-f42f-4113-b54d-52dab851c223 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:01.077433 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-31acbeac-f42f-4113-b54d-52dab851c223 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:01.077855 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-31acbeac-f42f-4113-b54d-52dab851c223 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:01.208999 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-31acbeac-f42f-4113-b54d-52dab851c223 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ab9c24c5404e1892bb44b09be583fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272a737decfd4dba9538dffbc7c1db5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:10:01.217264 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-31acbeac-f42f-4113-b54d-52dab851c223 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] 10.222.0.30 "GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd" status: 200 len: 1549 microversion: 2.1 time: 0.152740 Aug 09 07:10:01.217829 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 411/824] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:10:01 2022] GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:10:02.755617 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-59a56567-c37f-457b-bc1b-376e0cac4785 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc2b9d02-54fa-4b2e-b66e-55db7de163bb"}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:10:02.757913 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-59a56567-c37f-457b-bc1b-376e0cac4785 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] [instance: b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:10:02.764847 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-59a56567-c37f-457b-bc1b-376e0cac4785 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:02.765327 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-59a56567-c37f-457b-bc1b-376e0cac4785 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:02.765767 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-59a56567-c37f-457b-bc1b-376e0cac4785 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:02.766462 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-59a56567-c37f-457b-bc1b-376e0cac4785 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:02.766917 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-59a56567-c37f-457b-bc1b-376e0cac4785 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:02.767340 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-59a56567-c37f-457b-bc1b-376e0cac4785 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:03.000181 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-59a56567-c37f-457b-bc1b-376e0cac4785 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] 10.222.0.30 "POST /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.248445 Aug 09 07:10:03.000786 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 414/825] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Aug 9 07:10:02 2022] POST /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd/os-volume_attachments => generated 194 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:10:09.520390 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-dd2217c4-0e0e-4c82-aec4-cd99405888f9 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:10:09.521024 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-dd2217c4-0e0e-4c82-aec4-cd99405888f9 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] [instance: b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:10:09.524090 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:09.529382 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-dd2217c4-0e0e-4c82-aec4-cd99405888f9 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:09.529861 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-dd2217c4-0e0e-4c82-aec4-cd99405888f9 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:09.530296 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-dd2217c4-0e0e-4c82-aec4-cd99405888f9 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:09.531018 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-dd2217c4-0e0e-4c82-aec4-cd99405888f9 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:09.531476 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-dd2217c4-0e0e-4c82-aec4-cd99405888f9 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:09.531922 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-dd2217c4-0e0e-4c82-aec4-cd99405888f9 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:09.535355 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_cell1:SELECT=73 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:09.662330 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-dd2217c4-0e0e-4c82-aec4-cd99405888f9 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ab9c24c5404e1892bb44b09be583fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272a737decfd4dba9538dffbc7c1db5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:10:09.670807 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-dd2217c4-0e0e-4c82-aec4-cd99405888f9 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] 10.222.0.30 "GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd" status: 200 len: 1595 microversion: 2.1 time: 0.154293 Aug 09 07:10:09.671376 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 412/826] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:10:09 2022] GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd => generated 1595 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:10:11.396449 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=2 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:11.401338 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-ec1027af-3bea-4b87-837e-d2ff80d2c936 req-ac05645d-aaf2-4418-8e60-de333e750ba9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd", "tag": "6bc82b3c-3c4d-4507-9829-44df16ea5af8"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:10:11.410125 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:11.411493 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-ec1027af-3bea-4b87-837e-d2ff80d2c936 req-ac05645d-aaf2-4418-8e60-de333e750ba9 service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:11.412040 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-ec1027af-3bea-4b87-837e-d2ff80d2c936 req-ac05645d-aaf2-4418-8e60-de333e750ba9 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:11.412437 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-ec1027af-3bea-4b87-837e-d2ff80d2c936 req-ac05645d-aaf2-4418-8e60-de333e750ba9 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:11.423556 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:11.425901 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-ec1027af-3bea-4b87-837e-d2ff80d2c936 req-ac05645d-aaf2-4418-8e60-de333e750ba9 service nova] Creating event network-changed:6bc82b3c-3c4d-4507-9829-44df16ea5af8 for instance b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd on hv-cinder-85251 Aug 09 07:10:11.433059 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-ec1027af-3bea-4b87-837e-d2ff80d2c936 req-ac05645d-aaf2-4418-8e60-de333e750ba9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037920 Aug 09 07:10:11.436816 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 415/827] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:10:12.515938 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-ffc7eb9f-ef6b-4b68-98b3-a40415a95b44 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-558840660"}} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:10:12.516560 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-ffc7eb9f-ef6b-4b68-98b3-a40415a95b44 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] [instance: b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:10:12.523057 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ffc7eb9f-ef6b-4b68-98b3-a40415a95b44 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:12.524115 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ffc7eb9f-ef6b-4b68-98b3-a40415a95b44 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:12.524550 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ffc7eb9f-ef6b-4b68-98b3-a40415a95b44 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:12.525249 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ffc7eb9f-ef6b-4b68-98b3-a40415a95b44 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:12.525696 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ffc7eb9f-ef6b-4b68-98b3-a40415a95b44 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:12.526110 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ffc7eb9f-ef6b-4b68-98b3-a40415a95b44 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:12.662487 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.network.security_group_api [None req-ffc7eb9f-ef6b-4b68-98b3-a40415a95b44 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Adding security group 29d3b467-382a-40ef-8d46-fcea35c996d7 to port 6bc82b3c-3c4d-4507-9829-44df16ea5af8 Aug 09 07:10:12.992199 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-ffc7eb9f-ef6b-4b68-98b3-a40415a95b44 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] 10.222.0.30 "POST /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd/action" status: 202 len: 0 microversion: 2.1 time: 0.480002 Aug 09 07:10:12.993810 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 413/828] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 9 07:10:12 2022] POST /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd/action => generated 0 bytes in 483 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 07:10:13.012504 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-cf6359b1-cfac-479b-9aa5-6e8314695f7a tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:10:13.015118 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-cf6359b1-cfac-479b-9aa5-6e8314695f7a tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] [instance: b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:10:13.028652 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cf6359b1-cfac-479b-9aa5-6e8314695f7a tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:13.030297 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cf6359b1-cfac-479b-9aa5-6e8314695f7a tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:13.030987 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cf6359b1-cfac-479b-9aa5-6e8314695f7a tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:13.032104 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cf6359b1-cfac-479b-9aa5-6e8314695f7a tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:13.033161 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cf6359b1-cfac-479b-9aa5-6e8314695f7a tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:13.033905 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cf6359b1-cfac-479b-9aa5-6e8314695f7a tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:13.164694 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [req-0e19abad-021c-4c29-911c-1c6496d0b18e req-58baa9b1-4a3a-4750-9ec1-d8f466ff4265 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd", "tag": "6bc82b3c-3c4d-4507-9829-44df16ea5af8"}]} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:10:13.174479 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-0e19abad-021c-4c29-911c-1c6496d0b18e req-58baa9b1-4a3a-4750-9ec1-d8f466ff4265 service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:13.174969 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-0e19abad-021c-4c29-911c-1c6496d0b18e req-58baa9b1-4a3a-4750-9ec1-d8f466ff4265 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:13.175408 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-0e19abad-021c-4c29-911c-1c6496d0b18e req-58baa9b1-4a3a-4750-9ec1-d8f466ff4265 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:13.187183 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.compute.server_external_events [req-0e19abad-021c-4c29-911c-1c6496d0b18e req-58baa9b1-4a3a-4750-9ec1-d8f466ff4265 service nova] Creating event network-changed:6bc82b3c-3c4d-4507-9829-44df16ea5af8 for instance b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd on hv-cinder-85251 Aug 09 07:10:13.193927 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [req-0e19abad-021c-4c29-911c-1c6496d0b18e req-58baa9b1-4a3a-4750-9ec1-d8f466ff4265 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.191175 Aug 09 07:10:13.194732 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 414/829] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:10:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:10:13.201548 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-cf6359b1-cfac-479b-9aa5-6e8314695f7a tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ab9c24c5404e1892bb44b09be583fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272a737decfd4dba9538dffbc7c1db5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:10:13.209501 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-cf6359b1-cfac-479b-9aa5-6e8314695f7a tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] 10.222.0.30 "GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd" status: 200 len: 1760 microversion: 2.1 time: 0.210957 Aug 09 07:10:13.210077 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 416/830] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:10:12 2022] GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd => generated 1760 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:10:36.595403 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_api:SELECT=5 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:36.596712 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_cell1:SELECT=11 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:36.601128 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-2f434189-b44f-4562-8322-71d2e4849901 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2038825546", "imageRef": "5d2c35cc-2f3b-4a22-bd68-79c71882b6a2", "flavorRef": "452", "networks": [{"uuid": "50c95e54-a3c6-4a59-87ef-bb018c863de3"}]}} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:10:36.659017 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.network.neutron [None req-2f434189-b44f-4562-8322-71d2e4849901 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] validate_networks() for [('50c95e54-a3c6-4a59-87ef-bb018c863de3', None, None, None, None, None)] {{(pid=117858) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 07:10:37.055288 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.virt.hardware [None req-2f434189-b44f-4562-8322-71d2e4849901 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Flavor limits 0:0:0 {{(pid=117858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 07:10:37.055739 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.virt.hardware [None req-2f434189-b44f-4562-8322-71d2e4849901 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Image limits 0:0:0 {{(pid=117858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 07:10:37.056243 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.virt.hardware [None req-2f434189-b44f-4562-8322-71d2e4849901 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Flavor pref 0:0:0 {{(pid=117858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 07:10:37.056646 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.virt.hardware [None req-2f434189-b44f-4562-8322-71d2e4849901 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Image pref 0:0:0 {{(pid=117858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 07:10:37.057054 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.virt.hardware [None req-2f434189-b44f-4562-8322-71d2e4849901 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 07:10:37.065680 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2f434189-b44f-4562-8322-71d2e4849901 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:37.066152 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2f434189-b44f-4562-8322-71d2e4849901 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:37.066577 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2f434189-b44f-4562-8322-71d2e4849901 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:37.067287 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2f434189-b44f-4562-8322-71d2e4849901 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:37.067769 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2f434189-b44f-4562-8322-71d2e4849901 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:37.068188 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2f434189-b44f-4562-8322-71d2e4849901 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:37.084879 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.quota [None req-2f434189-b44f-4562-8322-71d2e4849901 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Getting quotas for project bd477a3a558642539d0bce76c8d505f3. Resources: {'cores', 'instances', 'ram'} {{(pid=117858) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 07:10:37.088724 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.quota [None req-2f434189-b44f-4562-8322-71d2e4849901 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Getting quotas for user b608ef770dec44b489230d044bf5892f and project bd477a3a558642539d0bce76c8d505f3. Resources: {'cores', 'instances', 'ram'} {{(pid=117858) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 07:10:37.100016 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-2f434189-b44f-4562-8322-71d2e4849901 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Going to run 1 instances... {{(pid=117858) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 07:10:37.102329 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-2f434189-b44f-4562-8322-71d2e4849901 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] [instance: 26ad334e-a0ea-4dee-ba3c-3eae15250d72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5d2c35cc-2f3b-4a22-bd68-79c71882b6a2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117858) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 07:10:37.147110 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-2f434189-b44f-4562-8322-71d2e4849901 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.553283 Aug 09 07:10:37.147781 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 415/831] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 9 07:10:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 07:10:37.158820 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-71348fff-1e73-42f3-845d-711e8ea329a4 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:10:37.159423 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-71348fff-1e73-42f3-845d-711e8ea329a4 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] [instance: 26ad334e-a0ea-4dee-ba3c-3eae15250d72] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:10:37.161870 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=3 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:37.163120 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=7 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:37.219509 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-71348fff-1e73-42f3-845d-711e8ea329a4 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b608ef770dec44b489230d044bf5892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd477a3a558642539d0bce76c8d505f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:10:37.226136 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-71348fff-1e73-42f3-845d-711e8ea329a4 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] 10.222.0.30 "GET /compute/v2.1/servers/26ad334e-a0ea-4dee-ba3c-3eae15250d72" status: 200 len: 1219 microversion: 2.1 time: 0.071074 Aug 09 07:10:37.226752 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 417/832] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:10:37 2022] GET /compute/v2.1/servers/26ad334e-a0ea-4dee-ba3c-3eae15250d72 => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:10:38.246945 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-80033da7-d37e-47ae-a99c-76b9c84cd4d7 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:10:38.247561 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-80033da7-d37e-47ae-a99c-76b9c84cd4d7 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] [instance: 26ad334e-a0ea-4dee-ba3c-3eae15250d72] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:10:38.253998 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-80033da7-d37e-47ae-a99c-76b9c84cd4d7 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:38.254479 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-80033da7-d37e-47ae-a99c-76b9c84cd4d7 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:38.254914 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-80033da7-d37e-47ae-a99c-76b9c84cd4d7 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:38.255624 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-80033da7-d37e-47ae-a99c-76b9c84cd4d7 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:38.256113 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-80033da7-d37e-47ae-a99c-76b9c84cd4d7 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:38.256552 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-80033da7-d37e-47ae-a99c-76b9c84cd4d7 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:38.318823 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-80033da7-d37e-47ae-a99c-76b9c84cd4d7 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b608ef770dec44b489230d044bf5892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd477a3a558642539d0bce76c8d505f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:10:38.327291 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-80033da7-d37e-47ae-a99c-76b9c84cd4d7 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] 10.222.0.30 "GET /compute/v2.1/servers/26ad334e-a0ea-4dee-ba3c-3eae15250d72" status: 200 len: 1277 microversion: 2.1 time: 0.084972 Aug 09 07:10:38.327898 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 416/833] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:10:38 2022] GET /compute/v2.1/servers/26ad334e-a0ea-4dee-ba3c-3eae15250d72 => generated 1277 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:10:38.763948 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e076fff1-35f8-4ab1-8ea9-acd556b58c6c tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:10:38.766199 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-e076fff1-35f8-4ab1-8ea9-acd556b58c6c tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] [instance: b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:10:38.773402 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e076fff1-35f8-4ab1-8ea9-acd556b58c6c tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:38.773885 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e076fff1-35f8-4ab1-8ea9-acd556b58c6c tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:38.774313 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e076fff1-35f8-4ab1-8ea9-acd556b58c6c tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:38.775010 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e076fff1-35f8-4ab1-8ea9-acd556b58c6c tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:38.775444 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e076fff1-35f8-4ab1-8ea9-acd556b58c6c tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:38.775891 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e076fff1-35f8-4ab1-8ea9-acd556b58c6c tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:38.849981 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-e076fff1-35f8-4ab1-8ea9-acd556b58c6c tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] 10.222.0.30 "POST /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd/action" status: 202 len: 0 microversion: 2.1 time: 0.090846 Aug 09 07:10:38.851142 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 418/834] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 9 07:10:38 2022] POST /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 07:10:38.859195 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-7fdbd4d6-eadd-4097-a257-1be0c1df2b0b tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:10:38.860470 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-7fdbd4d6-eadd-4097-a257-1be0c1df2b0b tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] [instance: b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:10:38.867936 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7fdbd4d6-eadd-4097-a257-1be0c1df2b0b tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:38.868427 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7fdbd4d6-eadd-4097-a257-1be0c1df2b0b tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:38.868895 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7fdbd4d6-eadd-4097-a257-1be0c1df2b0b tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:38.869586 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7fdbd4d6-eadd-4097-a257-1be0c1df2b0b tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:38.870215 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7fdbd4d6-eadd-4097-a257-1be0c1df2b0b tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:38.870642 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7fdbd4d6-eadd-4097-a257-1be0c1df2b0b tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:39.014743 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-7fdbd4d6-eadd-4097-a257-1be0c1df2b0b tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ab9c24c5404e1892bb44b09be583fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272a737decfd4dba9538dffbc7c1db5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:10:39.022706 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-7fdbd4d6-eadd-4097-a257-1be0c1df2b0b tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] 10.222.0.30 "GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd" status: 200 len: 1752 microversion: 2.1 time: 0.167845 Aug 09 07:10:39.023446 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 417/835] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:10:38 2022] GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd => generated 1752 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:10:39.349157 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2937b8a5-beec-4830-886b-431dc48ef8c8 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:10:39.349871 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-2937b8a5-beec-4830-886b-431dc48ef8c8 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] [instance: 26ad334e-a0ea-4dee-ba3c-3eae15250d72] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:10:39.357088 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2937b8a5-beec-4830-886b-431dc48ef8c8 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:39.357736 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2937b8a5-beec-4830-886b-431dc48ef8c8 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:39.358170 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2937b8a5-beec-4830-886b-431dc48ef8c8 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:39.358915 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2937b8a5-beec-4830-886b-431dc48ef8c8 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:39.359442 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2937b8a5-beec-4830-886b-431dc48ef8c8 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:39.360193 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2937b8a5-beec-4830-886b-431dc48ef8c8 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:39.499442 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2937b8a5-beec-4830-886b-431dc48ef8c8 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b608ef770dec44b489230d044bf5892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd477a3a558642539d0bce76c8d505f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:10:39.507212 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-2937b8a5-beec-4830-886b-431dc48ef8c8 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] 10.222.0.30 "GET /compute/v2.1/servers/26ad334e-a0ea-4dee-ba3c-3eae15250d72" status: 200 len: 1319 microversion: 2.1 time: 0.162250 Aug 09 07:10:39.511644 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 419/836] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:10:39 2022] GET /compute/v2.1/servers/26ad334e-a0ea-4dee-ba3c-3eae15250d72 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:10:39.672314 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [req-9e170547-fa1d-466c-a539-48a8191a2a0a req-a7d3ee11-6990-4b69-84f8-9d497cbc97c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26ad334e-a0ea-4dee-ba3c-3eae15250d72", "tag": "92c54b32-98ac-4d09-a4a8-ba9fdcf8899a"}]} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:10:39.683764 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-9e170547-fa1d-466c-a539-48a8191a2a0a req-a7d3ee11-6990-4b69-84f8-9d497cbc97c3 service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:39.684529 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-9e170547-fa1d-466c-a539-48a8191a2a0a req-a7d3ee11-6990-4b69-84f8-9d497cbc97c3 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:39.684965 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-9e170547-fa1d-466c-a539-48a8191a2a0a req-a7d3ee11-6990-4b69-84f8-9d497cbc97c3 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:39.697704 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.compute.server_external_events [req-9e170547-fa1d-466c-a539-48a8191a2a0a req-a7d3ee11-6990-4b69-84f8-9d497cbc97c3 service nova] Creating event network-changed:92c54b32-98ac-4d09-a4a8-ba9fdcf8899a for instance 26ad334e-a0ea-4dee-ba3c-3eae15250d72 on hv-cinder-85251 Aug 09 07:10:39.702563 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [req-9e170547-fa1d-466c-a539-48a8191a2a0a req-a7d3ee11-6990-4b69-84f8-9d497cbc97c3 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035431 Aug 09 07:10:39.703312 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 418/837] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:10:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:10:40.044826 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-37c0fb5f-55d6-405e-a427-3cdf71951165 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:10:40.045466 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-37c0fb5f-55d6-405e-a427-3cdf71951165 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] [instance: b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:10:40.051965 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-37c0fb5f-55d6-405e-a427-3cdf71951165 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:40.052448 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-37c0fb5f-55d6-405e-a427-3cdf71951165 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:40.052885 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-37c0fb5f-55d6-405e-a427-3cdf71951165 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:40.053579 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-37c0fb5f-55d6-405e-a427-3cdf71951165 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:40.054034 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-37c0fb5f-55d6-405e-a427-3cdf71951165 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:40.054461 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-37c0fb5f-55d6-405e-a427-3cdf71951165 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:40.351936 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-37c0fb5f-55d6-405e-a427-3cdf71951165 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ab9c24c5404e1892bb44b09be583fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272a737decfd4dba9538dffbc7c1db5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:10:40.360026 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-37c0fb5f-55d6-405e-a427-3cdf71951165 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] 10.222.0.30 "GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd" status: 200 len: 1752 microversion: 2.1 time: 0.319026 Aug 09 07:10:40.360587 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 420/838] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:10:40 2022] GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd => generated 1752 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:10:40.527903 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-a0440ee7-8683-4f50-8f3c-93ec8f03f1da tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:10:40.528768 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-a0440ee7-8683-4f50-8f3c-93ec8f03f1da tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] [instance: 26ad334e-a0ea-4dee-ba3c-3eae15250d72] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:10:40.534846 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a0440ee7-8683-4f50-8f3c-93ec8f03f1da tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:40.535405 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a0440ee7-8683-4f50-8f3c-93ec8f03f1da tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:40.535938 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a0440ee7-8683-4f50-8f3c-93ec8f03f1da tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:40.536652 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a0440ee7-8683-4f50-8f3c-93ec8f03f1da tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:40.537088 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a0440ee7-8683-4f50-8f3c-93ec8f03f1da tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:40.537567 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a0440ee7-8683-4f50-8f3c-93ec8f03f1da tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:40.667456 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-a0440ee7-8683-4f50-8f3c-93ec8f03f1da tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b608ef770dec44b489230d044bf5892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd477a3a558642539d0bce76c8d505f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:10:40.675647 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-a0440ee7-8683-4f50-8f3c-93ec8f03f1da tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] 10.222.0.30 "GET /compute/v2.1/servers/26ad334e-a0ea-4dee-ba3c-3eae15250d72" status: 200 len: 1319 microversion: 2.1 time: 0.152152 Aug 09 07:10:40.676212 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 419/839] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:10:40 2022] GET /compute/v2.1/servers/26ad334e-a0ea-4dee-ba3c-3eae15250d72 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:10:41.382079 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4df08d77-116d-49e8-945b-06f0183b2a51 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:10:41.382711 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4df08d77-116d-49e8-945b-06f0183b2a51 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] [instance: b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:10:41.389893 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4df08d77-116d-49e8-945b-06f0183b2a51 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:41.390368 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4df08d77-116d-49e8-945b-06f0183b2a51 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:41.390857 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4df08d77-116d-49e8-945b-06f0183b2a51 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:41.391542 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4df08d77-116d-49e8-945b-06f0183b2a51 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:41.392010 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4df08d77-116d-49e8-945b-06f0183b2a51 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:41.392456 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4df08d77-116d-49e8-945b-06f0183b2a51 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:41.537552 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4df08d77-116d-49e8-945b-06f0183b2a51 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ab9c24c5404e1892bb44b09be583fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272a737decfd4dba9538dffbc7c1db5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:10:41.545535 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4df08d77-116d-49e8-945b-06f0183b2a51 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] 10.222.0.30 "GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd" status: 200 len: 1757 microversion: 2.1 time: 0.167304 Aug 09 07:10:41.546172 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 421/840] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:10:41 2022] GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:10:41.696819 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-e74b5319-fd74-432b-99d5-6cc10f16e3b0 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:10:41.697498 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-e74b5319-fd74-432b-99d5-6cc10f16e3b0 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] [instance: 26ad334e-a0ea-4dee-ba3c-3eae15250d72] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:10:41.704438 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e74b5319-fd74-432b-99d5-6cc10f16e3b0 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:41.704913 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e74b5319-fd74-432b-99d5-6cc10f16e3b0 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:41.705341 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e74b5319-fd74-432b-99d5-6cc10f16e3b0 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:41.706044 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e74b5319-fd74-432b-99d5-6cc10f16e3b0 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:41.706471 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e74b5319-fd74-432b-99d5-6cc10f16e3b0 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:41.706885 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e74b5319-fd74-432b-99d5-6cc10f16e3b0 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:41.835053 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-e74b5319-fd74-432b-99d5-6cc10f16e3b0 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b608ef770dec44b489230d044bf5892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd477a3a558642539d0bce76c8d505f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:10:41.843264 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-e74b5319-fd74-432b-99d5-6cc10f16e3b0 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] 10.222.0.30 "GET /compute/v2.1/servers/26ad334e-a0ea-4dee-ba3c-3eae15250d72" status: 200 len: 1319 microversion: 2.1 time: 0.150192 Aug 09 07:10:41.843795 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 420/841] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:10:41 2022] GET /compute/v2.1/servers/26ad334e-a0ea-4dee-ba3c-3eae15250d72 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:10:42.567198 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-3da7ae0d-7def-455d-9bc4-b380df0a9b67 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:10:42.568577 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-3da7ae0d-7def-455d-9bc4-b380df0a9b67 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] [instance: b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:10:42.576293 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3da7ae0d-7def-455d-9bc4-b380df0a9b67 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:42.576626 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3da7ae0d-7def-455d-9bc4-b380df0a9b67 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:42.577225 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3da7ae0d-7def-455d-9bc4-b380df0a9b67 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:42.578002 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3da7ae0d-7def-455d-9bc4-b380df0a9b67 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:42.578526 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3da7ae0d-7def-455d-9bc4-b380df0a9b67 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:42.579037 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3da7ae0d-7def-455d-9bc4-b380df0a9b67 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:42.863563 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-9c335550-a7f1-47dd-a3a1-d804395d9f0a tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:10:42.864284 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-9c335550-a7f1-47dd-a3a1-d804395d9f0a tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] [instance: 26ad334e-a0ea-4dee-ba3c-3eae15250d72] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:10:42.871508 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9c335550-a7f1-47dd-a3a1-d804395d9f0a tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:42.872164 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9c335550-a7f1-47dd-a3a1-d804395d9f0a tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:42.872673 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9c335550-a7f1-47dd-a3a1-d804395d9f0a tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:42.873456 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9c335550-a7f1-47dd-a3a1-d804395d9f0a tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:42.874828 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9c335550-a7f1-47dd-a3a1-d804395d9f0a tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:42.875329 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9c335550-a7f1-47dd-a3a1-d804395d9f0a tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:43.039364 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-3da7ae0d-7def-455d-9bc4-b380df0a9b67 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ab9c24c5404e1892bb44b09be583fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272a737decfd4dba9538dffbc7c1db5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:10:43.049030 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-3da7ae0d-7def-455d-9bc4-b380df0a9b67 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] 10.222.0.30 "GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd" status: 200 len: 1757 microversion: 2.1 time: 0.486364 Aug 09 07:10:43.049626 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 422/842] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:10:42 2022] GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd => generated 1757 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:10:43.075584 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-9c335550-a7f1-47dd-a3a1-d804395d9f0a tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b608ef770dec44b489230d044bf5892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd477a3a558642539d0bce76c8d505f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:10:43.082867 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-9c335550-a7f1-47dd-a3a1-d804395d9f0a tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] 10.222.0.30 "GET /compute/v2.1/servers/26ad334e-a0ea-4dee-ba3c-3eae15250d72" status: 200 len: 1319 microversion: 2.1 time: 0.223331 Aug 09 07:10:43.083423 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 421/843] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:10:42 2022] GET /compute/v2.1/servers/26ad334e-a0ea-4dee-ba3c-3eae15250d72 => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:10:44.071269 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a037bac0-b491-4c9a-ac00-186192cf60de tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:10:44.071930 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-a037bac0-b491-4c9a-ac00-186192cf60de tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] [instance: b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:10:44.079018 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a037bac0-b491-4c9a-ac00-186192cf60de tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:44.079507 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a037bac0-b491-4c9a-ac00-186192cf60de tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:44.079980 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a037bac0-b491-4c9a-ac00-186192cf60de tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:44.080681 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a037bac0-b491-4c9a-ac00-186192cf60de tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:44.081141 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a037bac0-b491-4c9a-ac00-186192cf60de tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:44.081571 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a037bac0-b491-4c9a-ac00-186192cf60de tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:44.102188 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-4ee09433-ec92-4c32-83bd-5e969b994620 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:10:44.102821 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-4ee09433-ec92-4c32-83bd-5e969b994620 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] [instance: 26ad334e-a0ea-4dee-ba3c-3eae15250d72] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:10:44.110369 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4ee09433-ec92-4c32-83bd-5e969b994620 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:44.110903 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4ee09433-ec92-4c32-83bd-5e969b994620 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:44.111387 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4ee09433-ec92-4c32-83bd-5e969b994620 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:44.112114 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4ee09433-ec92-4c32-83bd-5e969b994620 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:44.112560 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4ee09433-ec92-4c32-83bd-5e969b994620 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:44.112979 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4ee09433-ec92-4c32-83bd-5e969b994620 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:44.297553 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-4ee09433-ec92-4c32-83bd-5e969b994620 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b608ef770dec44b489230d044bf5892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd477a3a558642539d0bce76c8d505f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:10:44.302479 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-a037bac0-b491-4c9a-ac00-186192cf60de tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ab9c24c5404e1892bb44b09be583fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272a737decfd4dba9538dffbc7c1db5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:10:44.305069 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-4ee09433-ec92-4c32-83bd-5e969b994620 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] 10.222.0.30 "GET /compute/v2.1/servers/26ad334e-a0ea-4dee-ba3c-3eae15250d72" status: 200 len: 1319 microversion: 2.1 time: 0.206717 Aug 09 07:10:44.305697 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 422/844] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:10:44 2022] GET /compute/v2.1/servers/26ad334e-a0ea-4dee-ba3c-3eae15250d72 => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:10:44.312912 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-a037bac0-b491-4c9a-ac00-186192cf60de tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] 10.222.0.30 "GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd" status: 200 len: 1757 microversion: 2.1 time: 0.245438 Aug 09 07:10:44.313602 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 423/845] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:10:44 2022] GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd => generated 1757 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:10:44.520213 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [req-d986b4e8-2e89-4046-b238-7709cd1dbdbd req-48eb8d04-6510-4854-af11-c913bbf83b9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26ad334e-a0ea-4dee-ba3c-3eae15250d72", "name": "network-vif-plugged", "status": "completed", "tag": "92c54b32-98ac-4d09-a4a8-ba9fdcf8899a"}]} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:10:44.530116 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-d986b4e8-2e89-4046-b238-7709cd1dbdbd req-48eb8d04-6510-4854-af11-c913bbf83b9f service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:44.530590 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-d986b4e8-2e89-4046-b238-7709cd1dbdbd req-48eb8d04-6510-4854-af11-c913bbf83b9f service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:44.531017 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-d986b4e8-2e89-4046-b238-7709cd1dbdbd req-48eb8d04-6510-4854-af11-c913bbf83b9f service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:44.541979 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.compute.server_external_events [req-d986b4e8-2e89-4046-b238-7709cd1dbdbd req-48eb8d04-6510-4854-af11-c913bbf83b9f service nova] Creating event network-vif-plugged:92c54b32-98ac-4d09-a4a8-ba9fdcf8899a for instance 26ad334e-a0ea-4dee-ba3c-3eae15250d72 on hv-cinder-85251 Aug 09 07:10:44.548082 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [req-d986b4e8-2e89-4046-b238-7709cd1dbdbd req-48eb8d04-6510-4854-af11-c913bbf83b9f service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031637 Aug 09 07:10:44.548701 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 423/846] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:10:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:10:45.327199 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c20f04f6-d662-4ab7-96e6-87b7ce17626b tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:10:45.327853 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c20f04f6-d662-4ab7-96e6-87b7ce17626b tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] [instance: 26ad334e-a0ea-4dee-ba3c-3eae15250d72] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:10:45.334193 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c20f04f6-d662-4ab7-96e6-87b7ce17626b tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:45.334673 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c20f04f6-d662-4ab7-96e6-87b7ce17626b tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:45.335109 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c20f04f6-d662-4ab7-96e6-87b7ce17626b tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:45.335912 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c20f04f6-d662-4ab7-96e6-87b7ce17626b tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:45.336366 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c20f04f6-d662-4ab7-96e6-87b7ce17626b tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:45.336792 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c20f04f6-d662-4ab7-96e6-87b7ce17626b tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:45.342072 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-267f555a-6ac9-423b-bcf5-e84b9fb46840 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:10:45.342774 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-267f555a-6ac9-423b-bcf5-e84b9fb46840 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] [instance: b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:10:45.348819 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-267f555a-6ac9-423b-bcf5-e84b9fb46840 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:45.349294 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-267f555a-6ac9-423b-bcf5-e84b9fb46840 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:45.349729 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-267f555a-6ac9-423b-bcf5-e84b9fb46840 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:45.350416 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-267f555a-6ac9-423b-bcf5-e84b9fb46840 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:45.350870 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-267f555a-6ac9-423b-bcf5-e84b9fb46840 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:45.351292 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-267f555a-6ac9-423b-bcf5-e84b9fb46840 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:45.542810 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c20f04f6-d662-4ab7-96e6-87b7ce17626b tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b608ef770dec44b489230d044bf5892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd477a3a558642539d0bce76c8d505f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:10:45.550420 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c20f04f6-d662-4ab7-96e6-87b7ce17626b tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] 10.222.0.30 "GET /compute/v2.1/servers/26ad334e-a0ea-4dee-ba3c-3eae15250d72" status: 200 len: 1319 microversion: 2.1 time: 0.227647 Aug 09 07:10:45.551275 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 424/847] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:10:45 2022] GET /compute/v2.1/servers/26ad334e-a0ea-4dee-ba3c-3eae15250d72 => generated 1319 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:10:45.558515 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-267f555a-6ac9-423b-bcf5-e84b9fb46840 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ab9c24c5404e1892bb44b09be583fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272a737decfd4dba9538dffbc7c1db5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:10:45.566898 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-267f555a-6ac9-423b-bcf5-e84b9fb46840 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] 10.222.0.30 "GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd" status: 200 len: 1757 microversion: 2.1 time: 0.230165 Aug 09 07:10:45.567449 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 424/848] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:10:45 2022] GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd => generated 1757 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:10:46.571581 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b67a3e90-1d12-4ab3-9c32-1c545c10c991 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:10:46.572210 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b67a3e90-1d12-4ab3-9c32-1c545c10c991 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] [instance: 26ad334e-a0ea-4dee-ba3c-3eae15250d72] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:10:46.580173 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b67a3e90-1d12-4ab3-9c32-1c545c10c991 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:46.580681 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b67a3e90-1d12-4ab3-9c32-1c545c10c991 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:46.581117 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b67a3e90-1d12-4ab3-9c32-1c545c10c991 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:46.581809 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b67a3e90-1d12-4ab3-9c32-1c545c10c991 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:46.582266 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b67a3e90-1d12-4ab3-9c32-1c545c10c991 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:46.582690 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b67a3e90-1d12-4ab3-9c32-1c545c10c991 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:46.588634 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-1eb07937-f727-4bad-b796-4dc510c5092d tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:10:46.589274 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-1eb07937-f727-4bad-b796-4dc510c5092d tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] [instance: b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:10:46.596307 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1eb07937-f727-4bad-b796-4dc510c5092d tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:46.596787 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1eb07937-f727-4bad-b796-4dc510c5092d tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:46.597223 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1eb07937-f727-4bad-b796-4dc510c5092d tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:46.597912 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1eb07937-f727-4bad-b796-4dc510c5092d tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:46.598363 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1eb07937-f727-4bad-b796-4dc510c5092d tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:46.598784 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1eb07937-f727-4bad-b796-4dc510c5092d tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:46.795889 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b67a3e90-1d12-4ab3-9c32-1c545c10c991 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b608ef770dec44b489230d044bf5892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd477a3a558642539d0bce76c8d505f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:10:46.803376 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b67a3e90-1d12-4ab3-9c32-1c545c10c991 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] 10.222.0.30 "GET /compute/v2.1/servers/26ad334e-a0ea-4dee-ba3c-3eae15250d72" status: 200 len: 1509 microversion: 2.1 time: 0.235564 Aug 09 07:10:46.803983 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 425/849] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:10:46 2022] GET /compute/v2.1/servers/26ad334e-a0ea-4dee-ba3c-3eae15250d72 => generated 1509 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:10:46.814073 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-1eb07937-f727-4bad-b796-4dc510c5092d tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ab9c24c5404e1892bb44b09be583fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272a737decfd4dba9538dffbc7c1db5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:10:46.823144 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-1eb07937-f727-4bad-b796-4dc510c5092d tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] 10.222.0.30 "GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd" status: 200 len: 1757 microversion: 2.1 time: 0.238289 Aug 09 07:10:46.823827 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 425/850] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:10:46 2022] GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd => generated 1757 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:10:47.846545 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-023376d7-92d0-4b1c-aacd-0cdb99b27d80 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:10:47.847182 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-023376d7-92d0-4b1c-aacd-0cdb99b27d80 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] [instance: b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:10:47.849285 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=2 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:47.855317 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-023376d7-92d0-4b1c-aacd-0cdb99b27d80 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:47.856628 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-023376d7-92d0-4b1c-aacd-0cdb99b27d80 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:47.856903 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-023376d7-92d0-4b1c-aacd-0cdb99b27d80 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:47.857596 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-023376d7-92d0-4b1c-aacd-0cdb99b27d80 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:47.858045 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-023376d7-92d0-4b1c-aacd-0cdb99b27d80 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:47.858473 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-023376d7-92d0-4b1c-aacd-0cdb99b27d80 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:48.011297 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-023376d7-92d0-4b1c-aacd-0cdb99b27d80 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ab9c24c5404e1892bb44b09be583fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272a737decfd4dba9538dffbc7c1db5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:10:48.019859 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-023376d7-92d0-4b1c-aacd-0cdb99b27d80 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] 10.222.0.30 "GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd" status: 200 len: 1757 microversion: 2.1 time: 0.177181 Aug 09 07:10:48.020460 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 426/851] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:10:47 2022] GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:10:49.042633 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-b1687580-58a8-44a3-846d-3dca99c5458f tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:10:49.043364 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-b1687580-58a8-44a3-846d-3dca99c5458f tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] [instance: b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:10:49.046053 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_cell0:SELECT=2 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:49.046745 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_cell0:SELECT=6 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:10:49.053480 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b1687580-58a8-44a3-846d-3dca99c5458f tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:49.053974 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b1687580-58a8-44a3-846d-3dca99c5458f tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:49.054414 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b1687580-58a8-44a3-846d-3dca99c5458f tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:49.055121 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b1687580-58a8-44a3-846d-3dca99c5458f tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:49.055579 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b1687580-58a8-44a3-846d-3dca99c5458f tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:49.056035 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b1687580-58a8-44a3-846d-3dca99c5458f tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:49.204187 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-b1687580-58a8-44a3-846d-3dca99c5458f tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ab9c24c5404e1892bb44b09be583fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272a737decfd4dba9538dffbc7c1db5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:10:49.212321 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-b1687580-58a8-44a3-846d-3dca99c5458f tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] 10.222.0.30 "GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd" status: 200 len: 1757 microversion: 2.1 time: 0.173854 Aug 09 07:10:49.212888 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 426/852] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:10:49 2022] GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:10:50.237203 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-3d9194d8-6b54-4097-8a45-4e7bb10000aa tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:10:50.237835 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-3d9194d8-6b54-4097-8a45-4e7bb10000aa tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] [instance: b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:10:50.244424 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3d9194d8-6b54-4097-8a45-4e7bb10000aa tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:50.244903 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3d9194d8-6b54-4097-8a45-4e7bb10000aa tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:50.245356 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3d9194d8-6b54-4097-8a45-4e7bb10000aa tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:50.246046 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3d9194d8-6b54-4097-8a45-4e7bb10000aa tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:50.246574 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3d9194d8-6b54-4097-8a45-4e7bb10000aa tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:50.246997 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3d9194d8-6b54-4097-8a45-4e7bb10000aa tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:50.396939 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-3d9194d8-6b54-4097-8a45-4e7bb10000aa tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ab9c24c5404e1892bb44b09be583fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272a737decfd4dba9538dffbc7c1db5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:10:50.405203 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-3d9194d8-6b54-4097-8a45-4e7bb10000aa tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] 10.222.0.30 "GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd" status: 200 len: 1757 microversion: 2.1 time: 0.172285 Aug 09 07:10:50.405701 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 427/853] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:10:50 2022] GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:10:51.427350 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-a1ee4993-f0e9-4ff8-8ff9-284f943a1612 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:10:51.428283 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-a1ee4993-f0e9-4ff8-8ff9-284f943a1612 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] [instance: b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:10:51.434783 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a1ee4993-f0e9-4ff8-8ff9-284f943a1612 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:51.435260 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a1ee4993-f0e9-4ff8-8ff9-284f943a1612 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:51.435721 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a1ee4993-f0e9-4ff8-8ff9-284f943a1612 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:51.436425 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a1ee4993-f0e9-4ff8-8ff9-284f943a1612 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:10:51.436873 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a1ee4993-f0e9-4ff8-8ff9-284f943a1612 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:10:51.437437 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a1ee4993-f0e9-4ff8-8ff9-284f943a1612 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:10:51.591074 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-a1ee4993-f0e9-4ff8-8ff9-284f943a1612 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ab9c24c5404e1892bb44b09be583fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272a737decfd4dba9538dffbc7c1db5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:10:51.599247 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-a1ee4993-f0e9-4ff8-8ff9-284f943a1612 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] 10.222.0.30 "GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd" status: 200 len: 1760 microversion: 2.1 time: 0.176509 Aug 09 07:10:51.599849 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 427/854] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:10:51 2022] GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd => generated 1760 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:11:00.925449 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d167c2ca-4015-49ed-b5c6-b54fc4e6b2a1 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c521196-8b18-4db4-828f-5298f74650a6", "device": "/dev/sdb"}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:11:00.928414 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-d167c2ca-4015-49ed-b5c6-b54fc4e6b2a1 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] [instance: 26ad334e-a0ea-4dee-ba3c-3eae15250d72] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:11:00.931706 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=24 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:11:00.932356 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:11:00.938592 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d167c2ca-4015-49ed-b5c6-b54fc4e6b2a1 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:00.939079 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d167c2ca-4015-49ed-b5c6-b54fc4e6b2a1 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:00.939516 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d167c2ca-4015-49ed-b5c6-b54fc4e6b2a1 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:00.940239 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d167c2ca-4015-49ed-b5c6-b54fc4e6b2a1 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:00.940694 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d167c2ca-4015-49ed-b5c6-b54fc4e6b2a1 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:00.941121 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d167c2ca-4015-49ed-b5c6-b54fc4e6b2a1 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:01.177799 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-d167c2ca-4015-49ed-b5c6-b54fc4e6b2a1 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] 10.222.0.30 "POST /compute/v2.1/servers/26ad334e-a0ea-4dee-ba3c-3eae15250d72/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.256116 Aug 09 07:11:01.178402 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 428/855] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Aug 9 07:11:00 2022] POST /compute/v2.1/servers/26ad334e-a0ea-4dee-ba3c-3eae15250d72/os-volume_attachments => generated 194 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:11:23.795876 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-3db29676-0a6f-488a-9d3f-520add3357b7 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:11:23.796406 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-3db29676-0a6f-488a-9d3f-520add3357b7 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] [instance: 26ad334e-a0ea-4dee-ba3c-3eae15250d72] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:11:23.798591 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:11:23.799230 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_cell1:SELECT=66 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:11:23.806240 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3db29676-0a6f-488a-9d3f-520add3357b7 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:23.806717 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3db29676-0a6f-488a-9d3f-520add3357b7 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:23.807147 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3db29676-0a6f-488a-9d3f-520add3357b7 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:23.807852 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3db29676-0a6f-488a-9d3f-520add3357b7 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:23.808301 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3db29676-0a6f-488a-9d3f-520add3357b7 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:23.808716 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3db29676-0a6f-488a-9d3f-520add3357b7 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:23.892424 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.objects.instance [None req-3db29676-0a6f-488a-9d3f-520add3357b7 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lazy-loading 'services' on Instance uuid 26ad334e-a0ea-4dee-ba3c-3eae15250d72 {{(pid=117858) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 07:11:23.963113 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-3db29676-0a6f-488a-9d3f-520add3357b7 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] 10.222.0.30 "DELETE /compute/v2.1/servers/26ad334e-a0ea-4dee-ba3c-3eae15250d72/os-volume_attachments/0c521196-8b18-4db4-828f-5298f74650a6" status: 202 len: 0 microversion: 2.1 time: 0.171019 Aug 09 07:11:23.963710 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 428/856] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Aug 9 07:11:23 2022] DELETE /compute/v2.1/servers/26ad334e-a0ea-4dee-ba3c-3eae15250d72/os-volume_attachments/0c521196-8b18-4db4-828f-5298f74650a6 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 07:11:25.081844 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=2 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:11:25.082600 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:11:25.088072 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-18c2fd1c-671f-4603-8a52-2db5146c25fc tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:11:25.088702 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-18c2fd1c-671f-4603-8a52-2db5146c25fc tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] [instance: 26ad334e-a0ea-4dee-ba3c-3eae15250d72] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:11:25.096377 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-18c2fd1c-671f-4603-8a52-2db5146c25fc tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:25.096855 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-18c2fd1c-671f-4603-8a52-2db5146c25fc tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:25.097288 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-18c2fd1c-671f-4603-8a52-2db5146c25fc tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:25.097969 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-18c2fd1c-671f-4603-8a52-2db5146c25fc tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:25.098417 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-18c2fd1c-671f-4603-8a52-2db5146c25fc tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:25.098835 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-18c2fd1c-671f-4603-8a52-2db5146c25fc tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:25.124167 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-18c2fd1c-671f-4603-8a52-2db5146c25fc tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] [instance: 26ad334e-a0ea-4dee-ba3c-3eae15250d72] Going to try to terminate instance {{(pid=117859) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 07:11:25.199852 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-18c2fd1c-671f-4603-8a52-2db5146c25fc tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] 10.222.0.30 "DELETE /compute/v2.1/servers/26ad334e-a0ea-4dee-ba3c-3eae15250d72" status: 204 len: 0 microversion: 2.1 time: 0.119151 Aug 09 07:11:25.200432 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 429/857] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 9 07:11:25 2022] DELETE /compute/v2.1/servers/26ad334e-a0ea-4dee-ba3c-3eae15250d72 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 07:11:25.210127 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-fcab2494-96c5-4536-9f92-bb91c6ec8ccf tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:11:25.211496 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-fcab2494-96c5-4536-9f92-bb91c6ec8ccf tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] [instance: 26ad334e-a0ea-4dee-ba3c-3eae15250d72] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:11:25.217613 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-fcab2494-96c5-4536-9f92-bb91c6ec8ccf tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:25.218092 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-fcab2494-96c5-4536-9f92-bb91c6ec8ccf tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:25.218537 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-fcab2494-96c5-4536-9f92-bb91c6ec8ccf tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:25.219225 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-fcab2494-96c5-4536-9f92-bb91c6ec8ccf tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:25.219703 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-fcab2494-96c5-4536-9f92-bb91c6ec8ccf tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:25.220133 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-fcab2494-96c5-4536-9f92-bb91c6ec8ccf tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:25.349031 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-fcab2494-96c5-4536-9f92-bb91c6ec8ccf tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b608ef770dec44b489230d044bf5892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd477a3a558642539d0bce76c8d505f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:11:25.356701 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-fcab2494-96c5-4536-9f92-bb91c6ec8ccf tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] 10.222.0.30 "GET /compute/v2.1/servers/26ad334e-a0ea-4dee-ba3c-3eae15250d72" status: 200 len: 1515 microversion: 2.1 time: 0.151379 Aug 09 07:11:25.357283 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 429/858] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:11:25 2022] GET /compute/v2.1/servers/26ad334e-a0ea-4dee-ba3c-3eae15250d72 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:11:26.378930 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-dd35ecb6-b71a-425c-9ee0-3b3166596e00 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:11:26.379637 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-dd35ecb6-b71a-425c-9ee0-3b3166596e00 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] [instance: 26ad334e-a0ea-4dee-ba3c-3eae15250d72] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:11:26.386022 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dd35ecb6-b71a-425c-9ee0-3b3166596e00 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:26.386496 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dd35ecb6-b71a-425c-9ee0-3b3166596e00 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:26.386926 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dd35ecb6-b71a-425c-9ee0-3b3166596e00 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:26.387616 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dd35ecb6-b71a-425c-9ee0-3b3166596e00 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:26.388080 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dd35ecb6-b71a-425c-9ee0-3b3166596e00 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:26.388497 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dd35ecb6-b71a-425c-9ee0-3b3166596e00 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:26.531751 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-dd35ecb6-b71a-425c-9ee0-3b3166596e00 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b608ef770dec44b489230d044bf5892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd477a3a558642539d0bce76c8d505f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:11:26.537568 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-dd35ecb6-b71a-425c-9ee0-3b3166596e00 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] 10.222.0.30 "GET /compute/v2.1/servers/26ad334e-a0ea-4dee-ba3c-3eae15250d72" status: 200 len: 1515 microversion: 2.1 time: 0.163083 Aug 09 07:11:26.538136 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 430/859] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:11:26 2022] GET /compute/v2.1/servers/26ad334e-a0ea-4dee-ba3c-3eae15250d72 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:11:27.500891 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [req-cb8c81e4-4c04-4f62-9898-ae5a47d5990a req-af2f6ca5-d110-43ef-8315-6089644185c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26ad334e-a0ea-4dee-ba3c-3eae15250d72", "name": "network-vif-deleted", "tag": "92c54b32-98ac-4d09-a4a8-ba9fdcf8899a"}]} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:11:27.511145 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-cb8c81e4-4c04-4f62-9898-ae5a47d5990a req-af2f6ca5-d110-43ef-8315-6089644185c9 service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:27.511632 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-cb8c81e4-4c04-4f62-9898-ae5a47d5990a req-af2f6ca5-d110-43ef-8315-6089644185c9 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:27.512057 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-cb8c81e4-4c04-4f62-9898-ae5a47d5990a req-af2f6ca5-d110-43ef-8315-6089644185c9 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:27.523380 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.compute.server_external_events [req-cb8c81e4-4c04-4f62-9898-ae5a47d5990a req-af2f6ca5-d110-43ef-8315-6089644185c9 service nova] Creating event network-vif-deleted:92c54b32-98ac-4d09-a4a8-ba9fdcf8899a for instance 26ad334e-a0ea-4dee-ba3c-3eae15250d72 on hv-cinder-85251 Aug 09 07:11:27.528513 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [req-cb8c81e4-4c04-4f62-9898-ae5a47d5990a req-af2f6ca5-d110-43ef-8315-6089644185c9 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031595 Aug 09 07:11:27.529111 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 430/860] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 07:11:27.558656 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-3000f26b-a2c1-4ee2-a64b-f9a1aa6407b0 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:11:27.559275 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-3000f26b-a2c1-4ee2-a64b-f9a1aa6407b0 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] [instance: 26ad334e-a0ea-4dee-ba3c-3eae15250d72] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:11:27.565817 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3000f26b-a2c1-4ee2-a64b-f9a1aa6407b0 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:27.566507 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3000f26b-a2c1-4ee2-a64b-f9a1aa6407b0 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:27.566950 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3000f26b-a2c1-4ee2-a64b-f9a1aa6407b0 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:27.567678 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3000f26b-a2c1-4ee2-a64b-f9a1aa6407b0 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:27.568141 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3000f26b-a2c1-4ee2-a64b-f9a1aa6407b0 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:27.568575 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3000f26b-a2c1-4ee2-a64b-f9a1aa6407b0 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:27.630996 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-3000f26b-a2c1-4ee2-a64b-f9a1aa6407b0 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b608ef770dec44b489230d044bf5892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd477a3a558642539d0bce76c8d505f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:11:27.639825 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-3000f26b-a2c1-4ee2-a64b-f9a1aa6407b0 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] 10.222.0.30 "GET /compute/v2.1/servers/26ad334e-a0ea-4dee-ba3c-3eae15250d72" status: 200 len: 1304 microversion: 2.1 time: 0.085322 Aug 09 07:11:27.640397 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 431/861] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:11:27 2022] GET /compute/v2.1/servers/26ad334e-a0ea-4dee-ba3c-3eae15250d72 => generated 1304 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:11:28.661991 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-331d92a2-fb59-41e0-a6ff-9e9c1c6d0b57 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:11:28.662687 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-331d92a2-fb59-41e0-a6ff-9e9c1c6d0b57 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] [instance: 26ad334e-a0ea-4dee-ba3c-3eae15250d72] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:11:28.669317 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-331d92a2-fb59-41e0-a6ff-9e9c1c6d0b57 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:28.669796 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-331d92a2-fb59-41e0-a6ff-9e9c1c6d0b57 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:28.670229 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-331d92a2-fb59-41e0-a6ff-9e9c1c6d0b57 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:28.670914 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-331d92a2-fb59-41e0-a6ff-9e9c1c6d0b57 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:28.671480 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-331d92a2-fb59-41e0-a6ff-9e9c1c6d0b57 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:28.671930 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-331d92a2-fb59-41e0-a6ff-9e9c1c6d0b57 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:28.686070 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.wsgi [None req-331d92a2-fb59-41e0-a6ff-9e9c1c6d0b57 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] HTTP exception thrown: Instance 26ad334e-a0ea-4dee-ba3c-3eae15250d72 could not be found. Aug 09 07:11:28.687716 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-331d92a2-fb59-41e0-a6ff-9e9c1c6d0b57 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Request method failure captured: Aug 09 07:11:28.687716 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: request: GET /compute/v2.1/servers/26ad334e-a0ea-4dee-ba3c-3eae15250d72 HTTP/1.1 Aug 09 07:11:28.687716 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Accept: application/json Aug 09 07:11:28.687716 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Accept-Encoding: identity Aug 09 07:11:28.687716 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Connection: close Aug 09 07:11:28.687716 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Content-Length: 0 Aug 09 07:11:28.687716 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Content-Type: application/json Aug 09 07:11:28.687716 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Host: 10.222.0.30 Aug 09 07:11:28.687716 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Openstack-System-Scope: None Aug 09 07:11:28.687716 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: User-Agent: python-urllib3/1.26.11 Aug 09 07:11:28.687716 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Auth-Token: gAAAAABi8ghrOLJyGM4vVRp7Xce7U-Eey64TLuNz12WQm7cew2q2d2pAtqls8mb3i5CN-z9dUewPppjPfZduk-RV8kfh4wW-JgOtmeKnkCWx1Wr5sDB6P-gwCe8T_a0EIxTeNwINfcpI3IngsDgvV3uWqQKHx0VG1mUexWMb4piAfj_n-Bt9kSU Aug 09 07:11:28.687716 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Domain-Id: None Aug 09 07:11:28.687716 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Domain-Name: None Aug 09 07:11:28.687716 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Identity-Status: Confirmed Aug 09 07:11:28.687716 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Is-Admin-Project: True Aug 09 07:11:28.687716 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Domain-Id: default Aug 09 07:11:28.687716 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Domain-Name: Default Aug 09 07:11:28.687716 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Id: bd477a3a558642539d0bce76c8d505f3 Aug 09 07:11:28.687716 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Name: tempest-VolumesSnapshotTestJSON-445548590 Aug 09 07:11:28.687716 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Role: reader,member Aug 09 07:11:28.687716 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Roles: reader,member Aug 09 07:11:28.689445 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bd477a3a558642539d0bce76c8d505f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_bd477a3a558642539d0bce76c8d505f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/bd477a3a558642539d0bce76c8d505f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bd477a3a558642539d0bce76c8d505f3"}]}] Aug 09 07:11:28.689445 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant: tempest-VolumesSnapshotTestJSON-445548590 Aug 09 07:11:28.689445 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant-Id: bd477a3a558642539d0bce76c8d505f3 Aug 09 07:11:28.689445 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-445548590 Aug 09 07:11:28.689445 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User: tempest-VolumesSnapshotTestJSON-445548590-project Aug 09 07:11:28.689445 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Domain-Id: default Aug 09 07:11:28.689445 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Domain-Name: Default Aug 09 07:11:28.689445 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Id: b608ef770dec44b489230d044bf5892f Aug 09 07:11:28.689445 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Name: tempest-VolumesSnapshotTestJSON-445548590-project Aug 09 07:11:28.689445 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: method: > Aug 09 07:11:28.689445 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: exception: Instance 26ad334e-a0ea-4dee-ba3c-3eae15250d72 could not be found. Aug 09 07:11:28.689445 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: action_args: {'id': '26ad334e-a0ea-4dee-ba3c-3eae15250d72'} Aug 09 07:11:28.690334 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 07:11:28.690334 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:11:28.690334 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 07:11:28.690334 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 07:11:28.690334 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 07:11:28.690334 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 07:11:28.690334 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 07:11:28.690334 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 07:11:28.690334 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 07:11:28.690334 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 07:11:28.690334 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26ad334e-a0ea-4dee-ba3c-3eae15250d72 could not be found. Aug 09 07:11:28.690334 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:11:28.690334 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:11:28.690334 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:11:28.690334 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:11:28.690334 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:11:28.690334 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:11:28.690334 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 07:11:28.690334 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 07:11:28.690334 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 07:11:28.691738 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 07:11:28.691738 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 07:11:28.691738 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 07:11:28.691738 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 07:11:28.691738 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 07:11:28.691738 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 07:11:28.691738 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 07:11:28.691738 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26ad334e-a0ea-4dee-ba3c-3eae15250d72 could not be found. Aug 09 07:11:28.691738 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:11:28.691738 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:11:28.691738 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:11:28.691738 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:11:28.691738 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:11:28.691738 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:11:28.691738 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 07:11:28.691738 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 07:11:28.691738 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26ad334e-a0ea-4dee-ba3c-3eae15250d72 could not be found. Aug 09 07:11:28.691738 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:11:28.692904 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-331d92a2-fb59-41e0-a6ff-9e9c1c6d0b57 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Returning 404 to user: Instance 26ad334e-a0ea-4dee-ba3c-3eae15250d72 could not be found. {{(pid=117858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 07:11:28.692904 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-331d92a2-fb59-41e0-a6ff-9e9c1c6d0b57 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] 10.222.0.30 "GET /compute/v2.1/servers/26ad334e-a0ea-4dee-ba3c-3eae15250d72" status: 404 len: 111 microversion: 2.1 time: 0.031745 Aug 09 07:11:28.692904 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 431/862] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:11:28 2022] GET /compute/v2.1/servers/26ad334e-a0ea-4dee-ba3c-3eae15250d72 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 07:11:31.878152 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4777dd3a-45ca-4e91-bdfc-d2969fb34a09 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-558840660"}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:11:31.888247 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4777dd3a-45ca-4e91-bdfc-d2969fb34a09 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] [instance: b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:11:31.891256 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4777dd3a-45ca-4e91-bdfc-d2969fb34a09 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:31.891788 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4777dd3a-45ca-4e91-bdfc-d2969fb34a09 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:31.892226 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4777dd3a-45ca-4e91-bdfc-d2969fb34a09 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:31.892923 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4777dd3a-45ca-4e91-bdfc-d2969fb34a09 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:31.893409 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4777dd3a-45ca-4e91-bdfc-d2969fb34a09 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:31.893802 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4777dd3a-45ca-4e91-bdfc-d2969fb34a09 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:32.026390 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.network.security_group_api [None req-4777dd3a-45ca-4e91-bdfc-d2969fb34a09 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Removing security group 29d3b467-382a-40ef-8d46-fcea35c996d7 from port 6bc82b3c-3c4d-4507-9829-44df16ea5af8 Aug 09 07:11:32.341741 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4777dd3a-45ca-4e91-bdfc-d2969fb34a09 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] 10.222.0.30 "POST /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd/action" status: 202 len: 0 microversion: 2.1 time: 0.467905 Aug 09 07:11:32.342351 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 432/863] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 9 07:11:31 2022] POST /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd/action => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 07:11:32.350614 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [req-17ef1be4-1e0f-4209-aa98-910ff28698db req-d168a09e-3418-4512-bc95-d77f4fd10d39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd", "tag": "6bc82b3c-3c4d-4507-9829-44df16ea5af8"}]} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:11:32.369681 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-17ef1be4-1e0f-4209-aa98-910ff28698db req-d168a09e-3418-4512-bc95-d77f4fd10d39 service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:32.378691 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-17ef1be4-1e0f-4209-aa98-910ff28698db req-d168a09e-3418-4512-bc95-d77f4fd10d39 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:32.379225 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-17ef1be4-1e0f-4209-aa98-910ff28698db req-d168a09e-3418-4512-bc95-d77f4fd10d39 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:32.399275 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.compute.server_external_events [req-17ef1be4-1e0f-4209-aa98-910ff28698db req-d168a09e-3418-4512-bc95-d77f4fd10d39 service nova] Creating event network-changed:6bc82b3c-3c4d-4507-9829-44df16ea5af8 for instance b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd on hv-cinder-85251 Aug 09 07:11:32.411103 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [req-17ef1be4-1e0f-4209-aa98-910ff28698db req-d168a09e-3418-4512-bc95-d77f4fd10d39 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064102 Aug 09 07:11:32.415554 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 432/864] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:11:33.477958 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-3d035425-45d8-4a53-a652-33b11e4f02f2 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:11:33.478498 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-3d035425-45d8-4a53-a652-33b11e4f02f2 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] [instance: b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:11:33.484457 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3d035425-45d8-4a53-a652-33b11e4f02f2 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:33.484938 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3d035425-45d8-4a53-a652-33b11e4f02f2 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:33.485378 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3d035425-45d8-4a53-a652-33b11e4f02f2 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:33.486080 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3d035425-45d8-4a53-a652-33b11e4f02f2 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:33.486534 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3d035425-45d8-4a53-a652-33b11e4f02f2 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:33.486960 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3d035425-45d8-4a53-a652-33b11e4f02f2 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:33.571046 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.objects.instance [None req-3d035425-45d8-4a53-a652-33b11e4f02f2 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lazy-loading 'services' on Instance uuid b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd {{(pid=117859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 07:11:33.644768 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-3d035425-45d8-4a53-a652-33b11e4f02f2 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd/os-volume_attachments/dc2b9d02-54fa-4b2e-b66e-55db7de163bb" status: 202 len: 0 microversion: 2.1 time: 0.171560 Aug 09 07:11:33.645349 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 433/865] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Aug 9 07:11:33 2022] DELETE /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd/os-volume_attachments/dc2b9d02-54fa-4b2e-b66e-55db7de163bb => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 07:11:33.654883 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-9dd24b82-f6bf-454f-939e-c241575d4ce0 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:11:33.657682 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-9dd24b82-f6bf-454f-939e-c241575d4ce0 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] [instance: b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:11:33.664762 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9dd24b82-f6bf-454f-939e-c241575d4ce0 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:33.665244 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9dd24b82-f6bf-454f-939e-c241575d4ce0 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:33.665679 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9dd24b82-f6bf-454f-939e-c241575d4ce0 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:33.666386 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9dd24b82-f6bf-454f-939e-c241575d4ce0 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:33.666844 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9dd24b82-f6bf-454f-939e-c241575d4ce0 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:33.667885 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9dd24b82-f6bf-454f-939e-c241575d4ce0 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:33.697496 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-9dd24b82-f6bf-454f-939e-c241575d4ce0 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] 10.222.0.30 "GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046873 Aug 09 07:11:33.698060 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 433/866] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 9 07:11:33 2022] GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:11:34.432974 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-f65a1ec6-d4ad-4537-9e60-1b9d088e4662 req-c6af992f-b1e0-43ce-af7a-70c5d6aa5a58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd", "tag": "6bc82b3c-3c4d-4507-9829-44df16ea5af8"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:11:34.442299 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-f65a1ec6-d4ad-4537-9e60-1b9d088e4662 req-c6af992f-b1e0-43ce-af7a-70c5d6aa5a58 service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:34.442768 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-f65a1ec6-d4ad-4537-9e60-1b9d088e4662 req-c6af992f-b1e0-43ce-af7a-70c5d6aa5a58 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:34.443191 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-f65a1ec6-d4ad-4537-9e60-1b9d088e4662 req-c6af992f-b1e0-43ce-af7a-70c5d6aa5a58 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:34.454763 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-f65a1ec6-d4ad-4537-9e60-1b9d088e4662 req-c6af992f-b1e0-43ce-af7a-70c5d6aa5a58 service nova] Creating event network-changed:6bc82b3c-3c4d-4507-9829-44df16ea5af8 for instance b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd on hv-cinder-85251 Aug 09 07:11:34.459527 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-f65a1ec6-d4ad-4537-9e60-1b9d088e4662 req-c6af992f-b1e0-43ce-af7a-70c5d6aa5a58 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031391 Aug 09 07:11:34.460203 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 434/867] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:11:34.710854 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-fd26ba7a-8c78-40cb-9a3f-37d736f67fcf tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:11:34.713048 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-fd26ba7a-8c78-40cb-9a3f-37d736f67fcf tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] [instance: b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:11:34.719532 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-fd26ba7a-8c78-40cb-9a3f-37d736f67fcf tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:34.720050 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-fd26ba7a-8c78-40cb-9a3f-37d736f67fcf tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:34.720491 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-fd26ba7a-8c78-40cb-9a3f-37d736f67fcf tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:34.721181 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-fd26ba7a-8c78-40cb-9a3f-37d736f67fcf tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:34.721637 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-fd26ba7a-8c78-40cb-9a3f-37d736f67fcf tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:34.722064 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-fd26ba7a-8c78-40cb-9a3f-37d736f67fcf tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:34.751231 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-fd26ba7a-8c78-40cb-9a3f-37d736f67fcf tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] 10.222.0.30 "GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044479 Aug 09 07:11:34.751830 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 434/868] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 9 07:11:34 2022] GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:11:35.765367 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-42ef05be-d281-42e8-be07-8101b9827399 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:11:35.767549 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-42ef05be-d281-42e8-be07-8101b9827399 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] [instance: b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:11:35.774707 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-42ef05be-d281-42e8-be07-8101b9827399 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:35.775181 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-42ef05be-d281-42e8-be07-8101b9827399 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:35.775628 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-42ef05be-d281-42e8-be07-8101b9827399 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:35.776312 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-42ef05be-d281-42e8-be07-8101b9827399 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:35.776761 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-42ef05be-d281-42e8-be07-8101b9827399 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:35.777181 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-42ef05be-d281-42e8-be07-8101b9827399 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:35.806138 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-42ef05be-d281-42e8-be07-8101b9827399 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] 10.222.0.30 "GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045499 Aug 09 07:11:35.806694 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 435/869] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 9 07:11:35 2022] GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:11:36.478651 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-3791d155-bdb3-406c-b5df-65c422f3eecd tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1971552133", "imageRef": "5d2c35cc-2f3b-4a22-bd68-79c71882b6a2", "flavorRef": "452", "networks": [{"uuid": "50c95e54-a3c6-4a59-87ef-bb018c863de3"}]}} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:11:36.535043 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.network.neutron [None req-3791d155-bdb3-406c-b5df-65c422f3eecd tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] validate_networks() for [('50c95e54-a3c6-4a59-87ef-bb018c863de3', None, None, None, None, None)] {{(pid=117858) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 07:11:36.818459 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-8ab65fa5-706a-437a-93ce-b5f74001d43f tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:11:36.820637 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-8ab65fa5-706a-437a-93ce-b5f74001d43f tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] [instance: b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:11:36.826955 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8ab65fa5-706a-437a-93ce-b5f74001d43f tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:36.827430 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8ab65fa5-706a-437a-93ce-b5f74001d43f tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:36.827909 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8ab65fa5-706a-437a-93ce-b5f74001d43f tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:36.828598 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8ab65fa5-706a-437a-93ce-b5f74001d43f tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:36.829045 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8ab65fa5-706a-437a-93ce-b5f74001d43f tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:36.829466 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8ab65fa5-706a-437a-93ce-b5f74001d43f tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:36.859192 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-8ab65fa5-706a-437a-93ce-b5f74001d43f tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] 10.222.0.30 "GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044742 Aug 09 07:11:36.860111 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 436/870] 10.222.0.30 () {58 vars in 1302 bytes} [Tue Aug 9 07:11:36 2022] GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 09 07:11:36.870154 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2749132d-0115-4f73-b2fa-28804366397b tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:11:36.870643 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-2749132d-0115-4f73-b2fa-28804366397b tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] [instance: b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:11:36.876709 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2749132d-0115-4f73-b2fa-28804366397b tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:36.877193 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2749132d-0115-4f73-b2fa-28804366397b tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:36.877735 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2749132d-0115-4f73-b2fa-28804366397b tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:36.878339 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2749132d-0115-4f73-b2fa-28804366397b tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:36.878803 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2749132d-0115-4f73-b2fa-28804366397b tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:36.879340 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2749132d-0115-4f73-b2fa-28804366397b tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:36.923618 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.virt.hardware [None req-3791d155-bdb3-406c-b5df-65c422f3eecd tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Flavor limits 0:0:0 {{(pid=117858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 07:11:36.924069 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.virt.hardware [None req-3791d155-bdb3-406c-b5df-65c422f3eecd tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Image limits 0:0:0 {{(pid=117858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 07:11:36.924543 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.virt.hardware [None req-3791d155-bdb3-406c-b5df-65c422f3eecd tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Flavor pref 0:0:0 {{(pid=117858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 07:11:36.924950 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.virt.hardware [None req-3791d155-bdb3-406c-b5df-65c422f3eecd tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Image pref 0:0:0 {{(pid=117858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 07:11:36.925363 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.virt.hardware [None req-3791d155-bdb3-406c-b5df-65c422f3eecd tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 07:11:36.934619 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3791d155-bdb3-406c-b5df-65c422f3eecd tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:36.934916 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3791d155-bdb3-406c-b5df-65c422f3eecd tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:36.935345 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3791d155-bdb3-406c-b5df-65c422f3eecd tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:36.936093 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3791d155-bdb3-406c-b5df-65c422f3eecd tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:36.936569 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3791d155-bdb3-406c-b5df-65c422f3eecd tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:36.937176 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3791d155-bdb3-406c-b5df-65c422f3eecd tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:36.954632 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.quota [None req-3791d155-bdb3-406c-b5df-65c422f3eecd tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Getting quotas for project bd477a3a558642539d0bce76c8d505f3. Resources: {'cores', 'instances', 'ram'} {{(pid=117858) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 07:11:36.958556 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.quota [None req-3791d155-bdb3-406c-b5df-65c422f3eecd tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Getting quotas for user b608ef770dec44b489230d044bf5892f and project bd477a3a558642539d0bce76c8d505f3. Resources: {'cores', 'instances', 'ram'} {{(pid=117858) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 07:11:36.958706 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-2749132d-0115-4f73-b2fa-28804366397b tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] HTTP exception thrown: Instance b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd is not attached to volume dc2b9d02-54fa-4b2e-b66e-55db7de163bb Aug 09 07:11:36.961812 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2749132d-0115-4f73-b2fa-28804366397b tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Request method failure captured: Aug 09 07:11:36.961812 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: request: DELETE /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd/os-volume_attachments/dc2b9d02-54fa-4b2e-b66e-55db7de163bb HTTP/1.1 Aug 09 07:11:36.961812 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 09 07:11:36.961812 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 09 07:11:36.961812 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Connection: close Aug 09 07:11:36.961812 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Length: 0 Aug 09 07:11:36.961812 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 09 07:11:36.961812 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.30 Aug 09 07:11:36.961812 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 09 07:11:36.961812 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.11 Aug 09 07:11:36.961812 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi8ggf49mJ4GrIRPhJ_A0eAU4_fDaqB9qiKZ3ZQKkUewUciRmH5vK9BtI0wywLW46sb6jM22AS70M9OzBWKMvIf5rRZgi6bOWEMPqeV6HA9ZTHCvr9HskKb1yYp1tmRzkyG3oUJ4wsZSuFEceZrrS6XG7pX2nlsLfyAbymS-J7uzbukRs Aug 09 07:11:36.961812 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 09 07:11:36.961812 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 09 07:11:36.961812 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 09 07:11:36.961812 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 09 07:11:36.961812 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 09 07:11:36.961812 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 09 07:11:36.961812 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Id: 272a737decfd4dba9538dffbc7c1db5b Aug 09 07:11:36.961812 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-TestMinimumBasicScenario-541858490 Aug 09 07:11:36.961812 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 09 07:11:36.961812 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 09 07:11:36.963246 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/272a737decfd4dba9538dffbc7c1db5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_272a737decfd4dba9538dffbc7c1db5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/272a737decfd4dba9538dffbc7c1db5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/272a737decfd4dba9538dffbc7c1db5b"}]}] Aug 09 07:11:36.963246 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-TestMinimumBasicScenario-541858490 Aug 09 07:11:36.963246 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: 272a737decfd4dba9538dffbc7c1db5b Aug 09 07:11:36.963246 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-TestMinimumBasicScenario-541858490 Aug 09 07:11:36.963246 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User: tempest-TestMinimumBasicScenario-541858490-project Aug 09 07:11:36.963246 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 09 07:11:36.963246 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 09 07:11:36.963246 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Id: 97ab9c24c5404e1892bb44b09be583fe Aug 09 07:11:36.963246 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-TestMinimumBasicScenario-541858490-project Aug 09 07:11:36.963246 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: method: > Aug 09 07:11:36.963246 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: exception: Instance b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd is not attached to volume dc2b9d02-54fa-4b2e-b66e-55db7de163bb Aug 09 07:11:36.964031 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: action_args: {'server_id': 'b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd', 'id': 'dc2b9d02-54fa-4b2e-b66e-55db7de163bb'} Aug 09 07:11:36.964031 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 07:11:36.964031 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:11:36.964031 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 09 07:11:36.964031 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 09 07:11:36.964031 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 09 07:11:36.964031 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 09 07:11:36.964031 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 09 07:11:36.964031 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 09 07:11:36.964031 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id dc2b9d02-54fa-4b2e-b66e-55db7de163bb. Aug 09 07:11:36.964031 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:11:36.964031 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:11:36.964031 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:11:36.964031 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:11:36.964031 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:11:36.964031 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:11:36.964031 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 07:11:36.964031 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 07:11:36.964031 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 07:11:36.965316 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 07:11:36.965316 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 09 07:11:36.965316 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 09 07:11:36.965316 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd is not attached to volume dc2b9d02-54fa-4b2e-b66e-55db7de163bb Aug 09 07:11:36.965316 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:11:36.965316 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:11:36.965316 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:11:36.965316 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:11:36.965316 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:11:36.965316 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:11:36.965316 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 07:11:36.965316 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 07:11:36.965316 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd is not attached to volume dc2b9d02-54fa-4b2e-b66e-55db7de163bb Aug 09 07:11:36.965316 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:11:36.965316 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2749132d-0115-4f73-b2fa-28804366397b tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Returning 404 to user: Instance b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd is not attached to volume dc2b9d02-54fa-4b2e-b66e-55db7de163bb {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 07:11:36.966259 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-2749132d-0115-4f73-b2fa-28804366397b tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd/os-volume_attachments/dc2b9d02-54fa-4b2e-b66e-55db7de163bb" status: 404 len: 154 microversion: 2.1 time: 0.097094 Aug 09 07:11:36.966259 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 437/871] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Aug 9 07:11:36 2022] DELETE /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd/os-volume_attachments/dc2b9d02-54fa-4b2e-b66e-55db7de163bb => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 09 07:11:36.971396 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-3791d155-bdb3-406c-b5df-65c422f3eecd tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Going to run 1 instances... {{(pid=117858) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 07:11:36.974285 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-3791d155-bdb3-406c-b5df-65c422f3eecd tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] [instance: 7f304985-432e-478b-8973-400677417f93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5d2c35cc-2f3b-4a22-bd68-79c71882b6a2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117858) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 07:11:37.021064 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-3791d155-bdb3-406c-b5df-65c422f3eecd tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.547377 Aug 09 07:11:37.021709 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 435/872] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 9 07:11:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 07:11:37.032585 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6d94d72c-dafd-4199-9da6-65deae3da79d tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:11:37.033356 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-6d94d72c-dafd-4199-9da6-65deae3da79d tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] [instance: 7f304985-432e-478b-8973-400677417f93] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:11:37.096039 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6d94d72c-dafd-4199-9da6-65deae3da79d tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b608ef770dec44b489230d044bf5892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd477a3a558642539d0bce76c8d505f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:11:37.103308 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-6d94d72c-dafd-4199-9da6-65deae3da79d tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] 10.222.0.30 "GET /compute/v2.1/servers/7f304985-432e-478b-8973-400677417f93" status: 200 len: 1219 microversion: 2.1 time: 0.074605 Aug 09 07:11:37.103899 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 438/873] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:11:37 2022] GET /compute/v2.1/servers/7f304985-432e-478b-8973-400677417f93 => generated 1219 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:11:38.123352 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-313a2be1-cc6b-4f0c-bfd4-164ca92b3834 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:11:38.124069 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-70c5ca73-adef-4647-aa4d-d77502450d82 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:11:38.124446 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-313a2be1-cc6b-4f0c-bfd4-164ca92b3834 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] [instance: 7f304985-432e-478b-8973-400677417f93] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:11:38.124552 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-70c5ca73-adef-4647-aa4d-d77502450d82 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] [instance: b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:11:38.131305 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-70c5ca73-adef-4647-aa4d-d77502450d82 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:38.132509 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-70c5ca73-adef-4647-aa4d-d77502450d82 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:38.132973 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-70c5ca73-adef-4647-aa4d-d77502450d82 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:38.133414 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-313a2be1-cc6b-4f0c-bfd4-164ca92b3834 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:38.133678 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-70c5ca73-adef-4647-aa4d-d77502450d82 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:38.134099 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-313a2be1-cc6b-4f0c-bfd4-164ca92b3834 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:38.134215 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-70c5ca73-adef-4647-aa4d-d77502450d82 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:38.134543 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-70c5ca73-adef-4647-aa4d-d77502450d82 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:38.134769 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-313a2be1-cc6b-4f0c-bfd4-164ca92b3834 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:38.135679 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-313a2be1-cc6b-4f0c-bfd4-164ca92b3834 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:38.136146 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-313a2be1-cc6b-4f0c-bfd4-164ca92b3834 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:38.136580 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-313a2be1-cc6b-4f0c-bfd4-164ca92b3834 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:38.163060 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-70c5ca73-adef-4647-aa4d-d77502450d82 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] [instance: b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd] Going to try to terminate instance {{(pid=117858) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 07:11:38.201434 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-313a2be1-cc6b-4f0c-bfd4-164ca92b3834 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b608ef770dec44b489230d044bf5892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd477a3a558642539d0bce76c8d505f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:11:38.208810 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-313a2be1-cc6b-4f0c-bfd4-164ca92b3834 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] 10.222.0.30 "GET /compute/v2.1/servers/7f304985-432e-478b-8973-400677417f93" status: 200 len: 1277 microversion: 2.1 time: 0.089411 Aug 09 07:11:38.209576 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 439/874] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:11:38 2022] GET /compute/v2.1/servers/7f304985-432e-478b-8973-400677417f93 => generated 1277 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:11:38.245852 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-70c5ca73-adef-4647-aa4d-d77502450d82 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] 10.222.0.30 "DELETE /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd" status: 204 len: 0 microversion: 2.1 time: 0.126281 Aug 09 07:11:38.246762 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 436/875] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 9 07:11:38 2022] DELETE /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 07:11:38.255514 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a1b2fbbf-69d9-4101-af32-ea01fcd70135 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:11:38.256158 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-a1b2fbbf-69d9-4101-af32-ea01fcd70135 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] [instance: b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:11:38.262729 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a1b2fbbf-69d9-4101-af32-ea01fcd70135 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:38.263205 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a1b2fbbf-69d9-4101-af32-ea01fcd70135 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:38.263674 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a1b2fbbf-69d9-4101-af32-ea01fcd70135 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:38.264359 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a1b2fbbf-69d9-4101-af32-ea01fcd70135 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:38.264804 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a1b2fbbf-69d9-4101-af32-ea01fcd70135 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:38.265223 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a1b2fbbf-69d9-4101-af32-ea01fcd70135 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:38.403460 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-a1b2fbbf-69d9-4101-af32-ea01fcd70135 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ab9c24c5404e1892bb44b09be583fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272a737decfd4dba9538dffbc7c1db5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:11:38.410982 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-a1b2fbbf-69d9-4101-af32-ea01fcd70135 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] 10.222.0.30 "GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd" status: 200 len: 1555 microversion: 2.1 time: 0.159556 Aug 09 07:11:38.411537 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 440/876] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:11:38 2022] GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:11:39.230849 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-8d4e54f0-1004-4334-a2ff-384ee4ac54b3 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:11:39.231553 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-8d4e54f0-1004-4334-a2ff-384ee4ac54b3 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] [instance: 7f304985-432e-478b-8973-400677417f93] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:11:39.237912 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-8d4e54f0-1004-4334-a2ff-384ee4ac54b3 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:39.238399 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-8d4e54f0-1004-4334-a2ff-384ee4ac54b3 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:39.238835 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-8d4e54f0-1004-4334-a2ff-384ee4ac54b3 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:39.239529 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-8d4e54f0-1004-4334-a2ff-384ee4ac54b3 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:39.240014 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-8d4e54f0-1004-4334-a2ff-384ee4ac54b3 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:39.240442 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-8d4e54f0-1004-4334-a2ff-384ee4ac54b3 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:39.368052 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-8d4e54f0-1004-4334-a2ff-384ee4ac54b3 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b608ef770dec44b489230d044bf5892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd477a3a558642539d0bce76c8d505f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:11:39.375767 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-8d4e54f0-1004-4334-a2ff-384ee4ac54b3 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] 10.222.0.30 "GET /compute/v2.1/servers/7f304985-432e-478b-8973-400677417f93" status: 200 len: 1319 microversion: 2.1 time: 0.148883 Aug 09 07:11:39.376330 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 437/877] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:11:39 2022] GET /compute/v2.1/servers/7f304985-432e-478b-8973-400677417f93 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:11:39.433181 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-950e73b6-9bd9-4025-a2ae-dfee17ee31fd tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:11:39.433784 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-950e73b6-9bd9-4025-a2ae-dfee17ee31fd tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] [instance: b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:11:39.440108 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-950e73b6-9bd9-4025-a2ae-dfee17ee31fd tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:39.440584 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-950e73b6-9bd9-4025-a2ae-dfee17ee31fd tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:39.441011 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-950e73b6-9bd9-4025-a2ae-dfee17ee31fd tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:39.441692 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-950e73b6-9bd9-4025-a2ae-dfee17ee31fd tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:39.442135 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-950e73b6-9bd9-4025-a2ae-dfee17ee31fd tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:39.442556 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-950e73b6-9bd9-4025-a2ae-dfee17ee31fd tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:39.572336 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-950e73b6-9bd9-4025-a2ae-dfee17ee31fd tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ab9c24c5404e1892bb44b09be583fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272a737decfd4dba9538dffbc7c1db5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:11:39.579743 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-950e73b6-9bd9-4025-a2ae-dfee17ee31fd tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] 10.222.0.30 "GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd" status: 200 len: 1555 microversion: 2.1 time: 0.150583 Aug 09 07:11:39.580295 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 441/878] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:11:39 2022] GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:11:40.358314 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [req-4c98a2da-94b2-4424-9d82-765c4965ab1d req-900c54ff-a825-440f-81e7-012d6e00dd5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f304985-432e-478b-8973-400677417f93", "tag": "7cd2b00c-8d80-4bb8-aa5c-7648d18a247e"}]} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:11:40.368980 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-4c98a2da-94b2-4424-9d82-765c4965ab1d req-900c54ff-a825-440f-81e7-012d6e00dd5e service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:40.369515 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-4c98a2da-94b2-4424-9d82-765c4965ab1d req-900c54ff-a825-440f-81e7-012d6e00dd5e service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:40.369948 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-4c98a2da-94b2-4424-9d82-765c4965ab1d req-900c54ff-a825-440f-81e7-012d6e00dd5e service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:40.380937 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.compute.server_external_events [req-4c98a2da-94b2-4424-9d82-765c4965ab1d req-900c54ff-a825-440f-81e7-012d6e00dd5e service nova] Creating event network-changed:7cd2b00c-8d80-4bb8-aa5c-7648d18a247e for instance 7f304985-432e-478b-8973-400677417f93 on hv-cinder-85251 Aug 09 07:11:40.386045 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [req-4c98a2da-94b2-4424-9d82-765c4965ab1d req-900c54ff-a825-440f-81e7-012d6e00dd5e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031797 Aug 09 07:11:40.386642 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 438/879] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:11:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:11:40.396347 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2dd8e846-104f-4246-b19c-f5628b3005fb tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:11:40.397035 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-2dd8e846-104f-4246-b19c-f5628b3005fb tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] [instance: 7f304985-432e-478b-8973-400677417f93] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:11:40.403880 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2dd8e846-104f-4246-b19c-f5628b3005fb tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:40.404359 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2dd8e846-104f-4246-b19c-f5628b3005fb tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:40.404789 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2dd8e846-104f-4246-b19c-f5628b3005fb tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:40.405477 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2dd8e846-104f-4246-b19c-f5628b3005fb tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:40.405921 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2dd8e846-104f-4246-b19c-f5628b3005fb tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:40.406339 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2dd8e846-104f-4246-b19c-f5628b3005fb tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:40.536192 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2dd8e846-104f-4246-b19c-f5628b3005fb tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b608ef770dec44b489230d044bf5892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd477a3a558642539d0bce76c8d505f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:11:40.544624 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-2dd8e846-104f-4246-b19c-f5628b3005fb tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] 10.222.0.30 "GET /compute/v2.1/servers/7f304985-432e-478b-8973-400677417f93" status: 200 len: 1319 microversion: 2.1 time: 0.152212 Aug 09 07:11:40.545272 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 442/880] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:11:40 2022] GET /compute/v2.1/servers/7f304985-432e-478b-8973-400677417f93 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:11:40.602450 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-418efbef-54ca-4956-8871-f4105f6c6510 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:11:40.603268 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-418efbef-54ca-4956-8871-f4105f6c6510 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] [instance: b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:11:40.610161 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-418efbef-54ca-4956-8871-f4105f6c6510 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:40.610648 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-418efbef-54ca-4956-8871-f4105f6c6510 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:40.611089 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-418efbef-54ca-4956-8871-f4105f6c6510 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:40.611829 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-418efbef-54ca-4956-8871-f4105f6c6510 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:40.612289 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-418efbef-54ca-4956-8871-f4105f6c6510 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:40.612718 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-418efbef-54ca-4956-8871-f4105f6c6510 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:40.746899 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-418efbef-54ca-4956-8871-f4105f6c6510 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ab9c24c5404e1892bb44b09be583fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272a737decfd4dba9538dffbc7c1db5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:11:40.755022 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-418efbef-54ca-4956-8871-f4105f6c6510 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] 10.222.0.30 "GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd" status: 200 len: 1555 microversion: 2.1 time: 0.157665 Aug 09 07:11:40.755620 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 439/881] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:11:40 2022] GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:11:41.564125 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-854a6cd7-df30-4c39-bfbc-3bd89eb97e95 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:11:41.564697 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-854a6cd7-df30-4c39-bfbc-3bd89eb97e95 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] [instance: 7f304985-432e-478b-8973-400677417f93] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:11:41.571158 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-854a6cd7-df30-4c39-bfbc-3bd89eb97e95 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:41.571662 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-854a6cd7-df30-4c39-bfbc-3bd89eb97e95 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:41.572103 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-854a6cd7-df30-4c39-bfbc-3bd89eb97e95 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:41.572789 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-854a6cd7-df30-4c39-bfbc-3bd89eb97e95 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:41.573241 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-854a6cd7-df30-4c39-bfbc-3bd89eb97e95 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:41.573663 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-854a6cd7-df30-4c39-bfbc-3bd89eb97e95 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:41.707329 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-854a6cd7-df30-4c39-bfbc-3bd89eb97e95 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b608ef770dec44b489230d044bf5892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd477a3a558642539d0bce76c8d505f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:11:41.714824 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-854a6cd7-df30-4c39-bfbc-3bd89eb97e95 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] 10.222.0.30 "GET /compute/v2.1/servers/7f304985-432e-478b-8973-400677417f93" status: 200 len: 1319 microversion: 2.1 time: 0.154643 Aug 09 07:11:41.715393 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 443/882] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:11:41 2022] GET /compute/v2.1/servers/7f304985-432e-478b-8973-400677417f93 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:11:41.777384 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-acaf9cc0-74f1-4550-81f6-3ad2576a3de4 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:11:41.777988 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-acaf9cc0-74f1-4550-81f6-3ad2576a3de4 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] [instance: b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:11:41.784276 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-acaf9cc0-74f1-4550-81f6-3ad2576a3de4 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:41.784787 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-acaf9cc0-74f1-4550-81f6-3ad2576a3de4 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:41.785213 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-acaf9cc0-74f1-4550-81f6-3ad2576a3de4 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:41.785897 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-acaf9cc0-74f1-4550-81f6-3ad2576a3de4 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:41.786341 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-acaf9cc0-74f1-4550-81f6-3ad2576a3de4 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:41.786756 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-acaf9cc0-74f1-4550-81f6-3ad2576a3de4 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:41.816416 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-acaf9cc0-74f1-4550-81f6-3ad2576a3de4 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:41.816819 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-acaf9cc0-74f1-4550-81f6-3ad2576a3de4 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:41.817247 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-acaf9cc0-74f1-4550-81f6-3ad2576a3de4 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:41.817686 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.objects.instance [None req-acaf9cc0-74f1-4550-81f6-3ad2576a3de4 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lazy-loading 'fault' on Instance uuid b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd {{(pid=117858) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 07:11:41.858808 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-acaf9cc0-74f1-4550-81f6-3ad2576a3de4 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97ab9c24c5404e1892bb44b09be583fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '272a737decfd4dba9538dffbc7c1db5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:11:41.866496 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-acaf9cc0-74f1-4550-81f6-3ad2576a3de4 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] 10.222.0.30 "GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd" status: 200 len: 1348 microversion: 2.1 time: 0.092787 Aug 09 07:11:41.867226 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 440/883] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:11:41 2022] GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd => generated 1348 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:11:42.425988 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-b5de2727-c669-43b7-9f76-94422acbb442 req-3d04526a-5874-4ffb-9eb0-8fe33f4cf890 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd", "name": "network-vif-deleted", "tag": "6bc82b3c-3c4d-4507-9829-44df16ea5af8"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:11:42.435505 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-b5de2727-c669-43b7-9f76-94422acbb442 req-3d04526a-5874-4ffb-9eb0-8fe33f4cf890 service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:42.436027 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-b5de2727-c669-43b7-9f76-94422acbb442 req-3d04526a-5874-4ffb-9eb0-8fe33f4cf890 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:42.436453 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-b5de2727-c669-43b7-9f76-94422acbb442 req-3d04526a-5874-4ffb-9eb0-8fe33f4cf890 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:42.447928 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-b5de2727-c669-43b7-9f76-94422acbb442 req-3d04526a-5874-4ffb-9eb0-8fe33f4cf890 service nova] Creating event network-vif-deleted:6bc82b3c-3c4d-4507-9829-44df16ea5af8 for instance b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd on hv-cinder-85251 Aug 09 07:11:42.453255 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-b5de2727-c669-43b7-9f76-94422acbb442 req-3d04526a-5874-4ffb-9eb0-8fe33f4cf890 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031115 Aug 09 07:11:42.453844 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 444/884] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:11:42.735701 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-453b3a33-f397-4649-8cae-261abe53ff56 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:11:42.736349 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-453b3a33-f397-4649-8cae-261abe53ff56 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] [instance: 7f304985-432e-478b-8973-400677417f93] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:11:42.742675 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-453b3a33-f397-4649-8cae-261abe53ff56 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:42.743160 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-453b3a33-f397-4649-8cae-261abe53ff56 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:42.743615 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-453b3a33-f397-4649-8cae-261abe53ff56 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:42.744310 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-453b3a33-f397-4649-8cae-261abe53ff56 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:42.744764 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-453b3a33-f397-4649-8cae-261abe53ff56 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:42.745188 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-453b3a33-f397-4649-8cae-261abe53ff56 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:42.880662 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-453b3a33-f397-4649-8cae-261abe53ff56 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b608ef770dec44b489230d044bf5892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd477a3a558642539d0bce76c8d505f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:11:42.889644 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-39124e55-3238-403d-a7dc-7a520a3b48c9 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:11:42.890392 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-39124e55-3238-403d-a7dc-7a520a3b48c9 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] [instance: b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:11:42.891170 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-453b3a33-f397-4649-8cae-261abe53ff56 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] 10.222.0.30 "GET /compute/v2.1/servers/7f304985-432e-478b-8973-400677417f93" status: 200 len: 1319 microversion: 2.1 time: 0.159411 Aug 09 07:11:42.892078 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 441/885] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:11:42 2022] GET /compute/v2.1/servers/7f304985-432e-478b-8973-400677417f93 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:11:42.896863 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-39124e55-3238-403d-a7dc-7a520a3b48c9 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:42.897515 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-39124e55-3238-403d-a7dc-7a520a3b48c9 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:42.897969 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-39124e55-3238-403d-a7dc-7a520a3b48c9 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:42.898886 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-39124e55-3238-403d-a7dc-7a520a3b48c9 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:42.899507 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-39124e55-3238-403d-a7dc-7a520a3b48c9 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:42.899976 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-39124e55-3238-403d-a7dc-7a520a3b48c9 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:42.920101 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-39124e55-3238-403d-a7dc-7a520a3b48c9 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] HTTP exception thrown: Instance b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd could not be found. Aug 09 07:11:42.922496 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-39124e55-3238-403d-a7dc-7a520a3b48c9 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Request method failure captured: Aug 09 07:11:42.922496 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd HTTP/1.1 Aug 09 07:11:42.922496 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 09 07:11:42.922496 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 09 07:11:42.922496 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Connection: close Aug 09 07:11:42.922496 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Length: 0 Aug 09 07:11:42.922496 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 09 07:11:42.922496 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.30 Aug 09 07:11:42.922496 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 09 07:11:42.922496 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.11 Aug 09 07:11:42.922496 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi8ggf49mJ4GrIRPhJ_A0eAU4_fDaqB9qiKZ3ZQKkUewUciRmH5vK9BtI0wywLW46sb6jM22AS70M9OzBWKMvIf5rRZgi6bOWEMPqeV6HA9ZTHCvr9HskKb1yYp1tmRzkyG3oUJ4wsZSuFEceZrrS6XG7pX2nlsLfyAbymS-J7uzbukRs Aug 09 07:11:42.922496 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 09 07:11:42.922496 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 09 07:11:42.922496 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 09 07:11:42.922496 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 09 07:11:42.922496 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 09 07:11:42.922496 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 09 07:11:42.922496 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Id: 272a737decfd4dba9538dffbc7c1db5b Aug 09 07:11:42.922496 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-TestMinimumBasicScenario-541858490 Aug 09 07:11:42.922496 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 09 07:11:42.922496 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 09 07:11:42.924118 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/272a737decfd4dba9538dffbc7c1db5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_272a737decfd4dba9538dffbc7c1db5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/272a737decfd4dba9538dffbc7c1db5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/272a737decfd4dba9538dffbc7c1db5b"}]}] Aug 09 07:11:42.924118 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-TestMinimumBasicScenario-541858490 Aug 09 07:11:42.924118 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: 272a737decfd4dba9538dffbc7c1db5b Aug 09 07:11:42.924118 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-TestMinimumBasicScenario-541858490 Aug 09 07:11:42.924118 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User: tempest-TestMinimumBasicScenario-541858490-project Aug 09 07:11:42.924118 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 09 07:11:42.924118 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 09 07:11:42.924118 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Id: 97ab9c24c5404e1892bb44b09be583fe Aug 09 07:11:42.924118 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-TestMinimumBasicScenario-541858490-project Aug 09 07:11:42.924118 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: method: > Aug 09 07:11:42.924118 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: exception: Instance b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd could not be found. Aug 09 07:11:42.924118 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: action_args: {'id': 'b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd'} Aug 09 07:11:42.925732 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 07:11:42.925732 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:11:42.925732 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 07:11:42.925732 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 07:11:42.925732 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 07:11:42.925732 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 07:11:42.925732 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 07:11:42.925732 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 07:11:42.925732 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 07:11:42.925732 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 07:11:42.925732 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd could not be found. Aug 09 07:11:42.925732 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:11:42.925732 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:11:42.925732 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:11:42.925732 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:11:42.925732 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:11:42.925732 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:11:42.925732 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 07:11:42.925732 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 07:11:42.925732 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 07:11:42.927219 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 07:11:42.927219 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 07:11:42.927219 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 07:11:42.927219 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 07:11:42.927219 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 07:11:42.927219 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 07:11:42.927219 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 07:11:42.927219 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd could not be found. Aug 09 07:11:42.927219 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:11:42.927219 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:11:42.927219 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:11:42.927219 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:11:42.927219 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:11:42.927219 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:11:42.927219 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 07:11:42.927219 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 07:11:42.927219 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd could not be found. Aug 09 07:11:42.927219 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:11:42.929455 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-39124e55-3238-403d-a7dc-7a520a3b48c9 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Returning 404 to user: Instance b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 07:11:42.929455 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-39124e55-3238-403d-a7dc-7a520a3b48c9 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] 10.222.0.30 "GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd" status: 404 len: 111 microversion: 2.1 time: 0.039143 Aug 09 07:11:42.929455 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 445/886] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:11:42 2022] GET /compute/v2.1/servers/b8af0ca2-64b0-46bc-8e8f-ca2e92b733dd => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 07:11:42.933719 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-c26af5b7-43ed-4de7-a7df-05ae5961ea55 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] Calling method '.version_select at 0x7f20ddacb040>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:11:42.952909 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-c26af5b7-43ed-4de7-a7df-05ae5961ea55 tempest-TestMinimumBasicScenario-541858490 tempest-TestMinimumBasicScenario-541858490-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-225926961" status: 202 len: 0 microversion: 2.1 time: 0.023157 Aug 09 07:11:42.953465 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 442/887] 10.222.0.30 () {58 vars in 1269 bytes} [Tue Aug 9 07:11:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-225926961 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 09 07:11:43.911611 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-62c91946-d26c-4ba3-83dc-0e2a4d244b25 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:11:43.912280 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-62c91946-d26c-4ba3-83dc-0e2a4d244b25 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] [instance: 7f304985-432e-478b-8973-400677417f93] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:11:43.919334 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-62c91946-d26c-4ba3-83dc-0e2a4d244b25 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:43.919851 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-62c91946-d26c-4ba3-83dc-0e2a4d244b25 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:43.920290 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-62c91946-d26c-4ba3-83dc-0e2a4d244b25 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:43.920984 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-62c91946-d26c-4ba3-83dc-0e2a4d244b25 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:43.921436 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-62c91946-d26c-4ba3-83dc-0e2a4d244b25 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:43.921859 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-62c91946-d26c-4ba3-83dc-0e2a4d244b25 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:43.940609 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:11:44.134934 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-62c91946-d26c-4ba3-83dc-0e2a4d244b25 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b608ef770dec44b489230d044bf5892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd477a3a558642539d0bce76c8d505f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:11:44.142380 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-62c91946-d26c-4ba3-83dc-0e2a4d244b25 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] 10.222.0.30 "GET /compute/v2.1/servers/7f304985-432e-478b-8973-400677417f93" status: 200 len: 1319 microversion: 2.1 time: 0.234660 Aug 09 07:11:44.142933 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 446/888] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:11:43 2022] GET /compute/v2.1/servers/7f304985-432e-478b-8973-400677417f93 => generated 1319 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:11:44.818827 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [req-1e95f726-47f3-4da9-9be7-d62a08201b54 req-3931c9c3-7efe-49a5-92e1-4f0c6a14d103 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f304985-432e-478b-8973-400677417f93", "name": "network-vif-plugged", "status": "completed", "tag": "7cd2b00c-8d80-4bb8-aa5c-7648d18a247e"}]} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:11:44.833275 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-1e95f726-47f3-4da9-9be7-d62a08201b54 req-3931c9c3-7efe-49a5-92e1-4f0c6a14d103 service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:44.833796 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-1e95f726-47f3-4da9-9be7-d62a08201b54 req-3931c9c3-7efe-49a5-92e1-4f0c6a14d103 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:44.834228 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-1e95f726-47f3-4da9-9be7-d62a08201b54 req-3931c9c3-7efe-49a5-92e1-4f0c6a14d103 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:44.851588 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.compute.server_external_events [req-1e95f726-47f3-4da9-9be7-d62a08201b54 req-3931c9c3-7efe-49a5-92e1-4f0c6a14d103 service nova] Creating event network-vif-plugged:7cd2b00c-8d80-4bb8-aa5c-7648d18a247e for instance 7f304985-432e-478b-8973-400677417f93 on hv-cinder-85251 Aug 09 07:11:44.863086 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [req-1e95f726-47f3-4da9-9be7-d62a08201b54 req-3931c9c3-7efe-49a5-92e1-4f0c6a14d103 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047363 Aug 09 07:11:44.863763 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 443/889] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:11:45.162617 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-0bd975da-d7a8-44c8-9dc5-2fd5140ea26a tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:11:45.164177 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-0bd975da-d7a8-44c8-9dc5-2fd5140ea26a tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] [instance: 7f304985-432e-478b-8973-400677417f93] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:11:45.170537 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0bd975da-d7a8-44c8-9dc5-2fd5140ea26a tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:45.171017 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0bd975da-d7a8-44c8-9dc5-2fd5140ea26a tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:45.171468 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0bd975da-d7a8-44c8-9dc5-2fd5140ea26a tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:45.172191 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0bd975da-d7a8-44c8-9dc5-2fd5140ea26a tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:45.172639 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0bd975da-d7a8-44c8-9dc5-2fd5140ea26a tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:45.173062 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0bd975da-d7a8-44c8-9dc5-2fd5140ea26a tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:45.315080 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-0bd975da-d7a8-44c8-9dc5-2fd5140ea26a tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b608ef770dec44b489230d044bf5892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd477a3a558642539d0bce76c8d505f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:11:45.323839 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-0bd975da-d7a8-44c8-9dc5-2fd5140ea26a tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] 10.222.0.30 "GET /compute/v2.1/servers/7f304985-432e-478b-8973-400677417f93" status: 200 len: 1319 microversion: 2.1 time: 0.164979 Aug 09 07:11:45.338136 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 447/890] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:11:45 2022] GET /compute/v2.1/servers/7f304985-432e-478b-8973-400677417f93 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:11:46.345938 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-9075682d-09de-4dd7-9524-e020ab6a315a tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:11:46.346720 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-9075682d-09de-4dd7-9524-e020ab6a315a tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] [instance: 7f304985-432e-478b-8973-400677417f93] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:11:46.353742 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9075682d-09de-4dd7-9524-e020ab6a315a tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:46.354237 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9075682d-09de-4dd7-9524-e020ab6a315a tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:46.354680 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9075682d-09de-4dd7-9524-e020ab6a315a tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:46.355440 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9075682d-09de-4dd7-9524-e020ab6a315a tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:46.356424 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9075682d-09de-4dd7-9524-e020ab6a315a tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:46.356424 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9075682d-09de-4dd7-9524-e020ab6a315a tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:46.555022 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-9075682d-09de-4dd7-9524-e020ab6a315a tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b608ef770dec44b489230d044bf5892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd477a3a558642539d0bce76c8d505f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:11:46.563087 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-9075682d-09de-4dd7-9524-e020ab6a315a tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] 10.222.0.30 "GET /compute/v2.1/servers/7f304985-432e-478b-8973-400677417f93" status: 200 len: 1319 microversion: 2.1 time: 0.221209 Aug 09 07:11:46.577854 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 444/891] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:11:46 2022] GET /compute/v2.1/servers/7f304985-432e-478b-8973-400677417f93 => generated 1319 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:11:47.588633 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-59da1c32-e30d-4843-836f-afb1d01074f2 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:11:47.589240 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-59da1c32-e30d-4843-836f-afb1d01074f2 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] [instance: 7f304985-432e-478b-8973-400677417f93] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:11:47.591887 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=2 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:11:47.597183 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-59da1c32-e30d-4843-836f-afb1d01074f2 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:47.597662 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-59da1c32-e30d-4843-836f-afb1d01074f2 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:47.598092 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-59da1c32-e30d-4843-836f-afb1d01074f2 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:47.598783 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-59da1c32-e30d-4843-836f-afb1d01074f2 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:47.599229 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-59da1c32-e30d-4843-836f-afb1d01074f2 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:47.599702 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-59da1c32-e30d-4843-836f-afb1d01074f2 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:47.743687 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-59da1c32-e30d-4843-836f-afb1d01074f2 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b608ef770dec44b489230d044bf5892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd477a3a558642539d0bce76c8d505f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:11:47.751402 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-59da1c32-e30d-4843-836f-afb1d01074f2 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] 10.222.0.30 "GET /compute/v2.1/servers/7f304985-432e-478b-8973-400677417f93" status: 200 len: 1509 microversion: 2.1 time: 0.167912 Aug 09 07:11:47.751989 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 448/892] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:11:47 2022] GET /compute/v2.1/servers/7f304985-432e-478b-8973-400677417f93 => generated 1509 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:11:47.772673 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-712ded3b-be35-4c81-bf4c-74e325dd7be9 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f930e68-4b14-40fa-95e1-241738bb7fcc", "device": "/dev/sdb"}} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:11:47.775942 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-712ded3b-be35-4c81-bf4c-74e325dd7be9 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] [instance: 7f304985-432e-478b-8973-400677417f93] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:11:47.777951 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_cell0:SELECT=2 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:11:47.779004 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_cell0:SELECT=6 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:11:47.784688 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-712ded3b-be35-4c81-bf4c-74e325dd7be9 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:47.785177 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-712ded3b-be35-4c81-bf4c-74e325dd7be9 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:47.785613 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-712ded3b-be35-4c81-bf4c-74e325dd7be9 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:47.786310 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-712ded3b-be35-4c81-bf4c-74e325dd7be9 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:11:47.786766 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-712ded3b-be35-4c81-bf4c-74e325dd7be9 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:11:47.787191 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-712ded3b-be35-4c81-bf4c-74e325dd7be9 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:11:48.022984 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:11:48.042475 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-712ded3b-be35-4c81-bf4c-74e325dd7be9 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] 10.222.0.30 "POST /compute/v2.1/servers/7f304985-432e-478b-8973-400677417f93/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274178 Aug 09 07:11:48.043689 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 445/893] 10.222.0.30 () {60 vars in 1323 bytes} [Tue Aug 9 07:11:47 2022] POST /compute/v2.1/servers/7f304985-432e-478b-8973-400677417f93/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:12:04.297262 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f8b3c37c-4c72-4326-b4e1-2e7ebd759055 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:12:04.297770 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-f8b3c37c-4c72-4326-b4e1-2e7ebd759055 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] [instance: 7f304985-432e-478b-8973-400677417f93] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:12:04.299780 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:12:04.300474 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=14 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:12:04.307185 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f8b3c37c-4c72-4326-b4e1-2e7ebd759055 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:12:04.307693 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f8b3c37c-4c72-4326-b4e1-2e7ebd759055 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:12:04.308133 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f8b3c37c-4c72-4326-b4e1-2e7ebd759055 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:12:04.308826 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f8b3c37c-4c72-4326-b4e1-2e7ebd759055 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:12:04.309279 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f8b3c37c-4c72-4326-b4e1-2e7ebd759055 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:12:04.309705 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f8b3c37c-4c72-4326-b4e1-2e7ebd759055 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:12:04.394123 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.objects.instance [None req-f8b3c37c-4c72-4326-b4e1-2e7ebd759055 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lazy-loading 'services' on Instance uuid 7f304985-432e-478b-8973-400677417f93 {{(pid=117859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 07:12:04.464859 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f8b3c37c-4c72-4326-b4e1-2e7ebd759055 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7f304985-432e-478b-8973-400677417f93/os-volume_attachments/0f930e68-4b14-40fa-95e1-241738bb7fcc" status: 202 len: 0 microversion: 2.1 time: 0.171471 Aug 09 07:12:04.465435 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 449/894] 10.222.0.30 () {58 vars in 1416 bytes} [Tue Aug 9 07:12:04 2022] DELETE /compute/v2.1/servers/7f304985-432e-478b-8973-400677417f93/os-volume_attachments/0f930e68-4b14-40fa-95e1-241738bb7fcc => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 07:12:05.582289 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:12:05.583167 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_cell1:SELECT=1,nova_cell1:INSERT=1 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:12:05.588030 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-0a6a54b9-0a60-4f74-be67-e5ee905bf285 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:12:05.588645 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-0a6a54b9-0a60-4f74-be67-e5ee905bf285 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] [instance: 7f304985-432e-478b-8973-400677417f93] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:12:05.596120 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0a6a54b9-0a60-4f74-be67-e5ee905bf285 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:12:05.596607 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0a6a54b9-0a60-4f74-be67-e5ee905bf285 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:12:05.597041 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0a6a54b9-0a60-4f74-be67-e5ee905bf285 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:12:05.597726 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0a6a54b9-0a60-4f74-be67-e5ee905bf285 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:12:05.598176 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0a6a54b9-0a60-4f74-be67-e5ee905bf285 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:12:05.598598 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0a6a54b9-0a60-4f74-be67-e5ee905bf285 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:12:05.624521 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-0a6a54b9-0a60-4f74-be67-e5ee905bf285 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] [instance: 7f304985-432e-478b-8973-400677417f93] Going to try to terminate instance {{(pid=117858) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 07:12:05.701868 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-0a6a54b9-0a60-4f74-be67-e5ee905bf285 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] 10.222.0.30 "DELETE /compute/v2.1/servers/7f304985-432e-478b-8973-400677417f93" status: 204 len: 0 microversion: 2.1 time: 0.120754 Aug 09 07:12:05.702435 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 446/895] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 9 07:12:05 2022] DELETE /compute/v2.1/servers/7f304985-432e-478b-8973-400677417f93 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 07:12:05.712492 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e85a57b9-4336-4d5c-92c8-711ff65c3d4f tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:12:05.713295 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-e85a57b9-4336-4d5c-92c8-711ff65c3d4f tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] [instance: 7f304985-432e-478b-8973-400677417f93] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:12:05.719513 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e85a57b9-4336-4d5c-92c8-711ff65c3d4f tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:12:05.720030 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e85a57b9-4336-4d5c-92c8-711ff65c3d4f tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:12:05.720471 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e85a57b9-4336-4d5c-92c8-711ff65c3d4f tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:12:05.721167 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e85a57b9-4336-4d5c-92c8-711ff65c3d4f tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:12:05.721658 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e85a57b9-4336-4d5c-92c8-711ff65c3d4f tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:12:05.722086 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e85a57b9-4336-4d5c-92c8-711ff65c3d4f tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:12:05.853529 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e85a57b9-4336-4d5c-92c8-711ff65c3d4f tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b608ef770dec44b489230d044bf5892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd477a3a558642539d0bce76c8d505f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:12:05.861144 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-e85a57b9-4336-4d5c-92c8-711ff65c3d4f tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] 10.222.0.30 "GET /compute/v2.1/servers/7f304985-432e-478b-8973-400677417f93" status: 200 len: 1515 microversion: 2.1 time: 0.154237 Aug 09 07:12:05.861702 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 450/896] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:12:05 2022] GET /compute/v2.1/servers/7f304985-432e-478b-8973-400677417f93 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:12:06.883616 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-4fd691bb-4eee-4520-8b2e-6723555871b2 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:12:06.884343 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-4fd691bb-4eee-4520-8b2e-6723555871b2 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] [instance: 7f304985-432e-478b-8973-400677417f93] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:12:06.890619 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4fd691bb-4eee-4520-8b2e-6723555871b2 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:12:06.891098 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4fd691bb-4eee-4520-8b2e-6723555871b2 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:12:06.891527 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4fd691bb-4eee-4520-8b2e-6723555871b2 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:12:06.892249 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4fd691bb-4eee-4520-8b2e-6723555871b2 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:12:06.892699 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4fd691bb-4eee-4520-8b2e-6723555871b2 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:12:06.893121 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4fd691bb-4eee-4520-8b2e-6723555871b2 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:12:07.018811 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-4fd691bb-4eee-4520-8b2e-6723555871b2 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b608ef770dec44b489230d044bf5892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd477a3a558642539d0bce76c8d505f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:12:07.027301 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-4fd691bb-4eee-4520-8b2e-6723555871b2 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] 10.222.0.30 "GET /compute/v2.1/servers/7f304985-432e-478b-8973-400677417f93" status: 200 len: 1515 microversion: 2.1 time: 0.148532 Aug 09 07:12:07.027927 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 447/897] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:12:06 2022] GET /compute/v2.1/servers/7f304985-432e-478b-8973-400677417f93 => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:12:07.770824 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-af7976de-c18f-4c11-a3df-fb0f68333d17 req-561d2186-56cf-4d26-aaf4-6b9c32a3aae2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f304985-432e-478b-8973-400677417f93", "name": "network-vif-deleted", "tag": "7cd2b00c-8d80-4bb8-aa5c-7648d18a247e"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:12:07.782179 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-af7976de-c18f-4c11-a3df-fb0f68333d17 req-561d2186-56cf-4d26-aaf4-6b9c32a3aae2 service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:12:07.783504 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-af7976de-c18f-4c11-a3df-fb0f68333d17 req-561d2186-56cf-4d26-aaf4-6b9c32a3aae2 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:12:07.783996 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-af7976de-c18f-4c11-a3df-fb0f68333d17 req-561d2186-56cf-4d26-aaf4-6b9c32a3aae2 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:12:07.798256 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-af7976de-c18f-4c11-a3df-fb0f68333d17 req-561d2186-56cf-4d26-aaf4-6b9c32a3aae2 service nova] Creating event network-vif-deleted:7cd2b00c-8d80-4bb8-aa5c-7648d18a247e for instance 7f304985-432e-478b-8973-400677417f93 on hv-cinder-85251 Aug 09 07:12:07.802965 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-af7976de-c18f-4c11-a3df-fb0f68333d17 req-561d2186-56cf-4d26-aaf4-6b9c32a3aae2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035993 Aug 09 07:12:07.803554 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 451/898] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:12:08.047840 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-6396d800-8d45-4f74-a68b-76dc3693e533 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:12:08.048448 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-6396d800-8d45-4f74-a68b-76dc3693e533 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] [instance: 7f304985-432e-478b-8973-400677417f93] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:12:08.054809 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6396d800-8d45-4f74-a68b-76dc3693e533 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:12:08.055281 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6396d800-8d45-4f74-a68b-76dc3693e533 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:12:08.055750 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6396d800-8d45-4f74-a68b-76dc3693e533 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:12:08.056431 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6396d800-8d45-4f74-a68b-76dc3693e533 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:12:08.056875 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6396d800-8d45-4f74-a68b-76dc3693e533 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:12:08.057292 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6396d800-8d45-4f74-a68b-76dc3693e533 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:12:08.087691 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6396d800-8d45-4f74-a68b-76dc3693e533 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:12:08.088173 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6396d800-8d45-4f74-a68b-76dc3693e533 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:12:08.088602 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6396d800-8d45-4f74-a68b-76dc3693e533 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:12:08.089042 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.objects.instance [None req-6396d800-8d45-4f74-a68b-76dc3693e533 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lazy-loading 'fault' on Instance uuid 7f304985-432e-478b-8973-400677417f93 {{(pid=117858) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 07:12:08.132646 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-6396d800-8d45-4f74-a68b-76dc3693e533 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b608ef770dec44b489230d044bf5892f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd477a3a558642539d0bce76c8d505f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:12:08.140483 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-6396d800-8d45-4f74-a68b-76dc3693e533 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] 10.222.0.30 "GET /compute/v2.1/servers/7f304985-432e-478b-8973-400677417f93" status: 200 len: 1309 microversion: 2.1 time: 0.096494 Aug 09 07:12:08.141051 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 448/899] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:12:08 2022] GET /compute/v2.1/servers/7f304985-432e-478b-8973-400677417f93 => generated 1309 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:12:09.162469 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-25220473-66e6-46f8-b6b3-eefd640a6900 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:12:09.163221 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-25220473-66e6-46f8-b6b3-eefd640a6900 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] [instance: 7f304985-432e-478b-8973-400677417f93] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:12:09.169765 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-25220473-66e6-46f8-b6b3-eefd640a6900 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:12:09.170243 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-25220473-66e6-46f8-b6b3-eefd640a6900 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:12:09.170677 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-25220473-66e6-46f8-b6b3-eefd640a6900 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:12:09.171363 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-25220473-66e6-46f8-b6b3-eefd640a6900 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:12:09.171843 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-25220473-66e6-46f8-b6b3-eefd640a6900 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:12:09.172271 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-25220473-66e6-46f8-b6b3-eefd640a6900 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:12:09.185391 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-25220473-66e6-46f8-b6b3-eefd640a6900 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] HTTP exception thrown: Instance 7f304985-432e-478b-8973-400677417f93 could not be found. Aug 09 07:12:09.187041 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-25220473-66e6-46f8-b6b3-eefd640a6900 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Request method failure captured: Aug 09 07:12:09.187041 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/7f304985-432e-478b-8973-400677417f93 HTTP/1.1 Aug 09 07:12:09.187041 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 09 07:12:09.187041 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 09 07:12:09.187041 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Connection: close Aug 09 07:12:09.187041 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Length: 0 Aug 09 07:12:09.187041 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 09 07:12:09.187041 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.30 Aug 09 07:12:09.187041 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 09 07:12:09.187041 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.11 Aug 09 07:12:09.187041 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi8ghrOLJyGM4vVRp7Xce7U-Eey64TLuNz12WQm7cew2q2d2pAtqls8mb3i5CN-z9dUewPppjPfZduk-RV8kfh4wW-JgOtmeKnkCWx1Wr5sDB6P-gwCe8T_a0EIxTeNwINfcpI3IngsDgvV3uWqQKHx0VG1mUexWMb4piAfj_n-Bt9kSU Aug 09 07:12:09.187041 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 09 07:12:09.187041 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 09 07:12:09.187041 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 09 07:12:09.187041 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 09 07:12:09.187041 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 09 07:12:09.187041 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 09 07:12:09.187041 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Id: bd477a3a558642539d0bce76c8d505f3 Aug 09 07:12:09.187041 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-VolumesSnapshotTestJSON-445548590 Aug 09 07:12:09.187041 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 09 07:12:09.187041 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 09 07:12:09.188774 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bd477a3a558642539d0bce76c8d505f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_bd477a3a558642539d0bce76c8d505f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/bd477a3a558642539d0bce76c8d505f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/bd477a3a558642539d0bce76c8d505f3"}]}] Aug 09 07:12:09.188774 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-VolumesSnapshotTestJSON-445548590 Aug 09 07:12:09.188774 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: bd477a3a558642539d0bce76c8d505f3 Aug 09 07:12:09.188774 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-445548590 Aug 09 07:12:09.188774 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User: tempest-VolumesSnapshotTestJSON-445548590-project Aug 09 07:12:09.188774 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 09 07:12:09.188774 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 09 07:12:09.188774 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Id: b608ef770dec44b489230d044bf5892f Aug 09 07:12:09.188774 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-VolumesSnapshotTestJSON-445548590-project Aug 09 07:12:09.188774 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: method: > Aug 09 07:12:09.188774 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: exception: Instance 7f304985-432e-478b-8973-400677417f93 could not be found. Aug 09 07:12:09.188774 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: action_args: {'id': '7f304985-432e-478b-8973-400677417f93'} Aug 09 07:12:09.189573 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 07:12:09.189573 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:12:09.189573 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 07:12:09.189573 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 07:12:09.189573 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 07:12:09.189573 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 07:12:09.189573 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 07:12:09.189573 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 07:12:09.189573 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 07:12:09.189573 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 07:12:09.189573 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f304985-432e-478b-8973-400677417f93 could not be found. Aug 09 07:12:09.189573 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:12:09.189573 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:12:09.189573 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:12:09.189573 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:12:09.189573 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:12:09.189573 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:12:09.189573 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 07:12:09.189573 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 07:12:09.189573 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 07:12:09.190903 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 07:12:09.190903 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 07:12:09.190903 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 07:12:09.190903 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 07:12:09.190903 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 07:12:09.190903 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 07:12:09.190903 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 07:12:09.190903 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f304985-432e-478b-8973-400677417f93 could not be found. Aug 09 07:12:09.190903 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:12:09.190903 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:12:09.190903 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:12:09.190903 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:12:09.190903 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:12:09.190903 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:12:09.190903 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 07:12:09.190903 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 07:12:09.190903 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f304985-432e-478b-8973-400677417f93 could not be found. Aug 09 07:12:09.190903 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:12:09.192128 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-25220473-66e6-46f8-b6b3-eefd640a6900 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] Returning 404 to user: Instance 7f304985-432e-478b-8973-400677417f93 could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 07:12:09.192128 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-25220473-66e6-46f8-b6b3-eefd640a6900 tempest-VolumesSnapshotTestJSON-445548590 tempest-VolumesSnapshotTestJSON-445548590-project] 10.222.0.30 "GET /compute/v2.1/servers/7f304985-432e-478b-8973-400677417f93" status: 404 len: 111 microversion: 2.1 time: 0.030704 Aug 09 07:12:09.192128 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 452/900] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:12:09 2022] GET /compute/v2.1/servers/7f304985-432e-478b-8973-400677417f93 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 07:12:40.743937 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:12:40.744931 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:12:40.978409 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-0a539e52-534d-4a2e-8291-7d3932812dc5 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Action: 'create', calling method: .version_select at 0x7f20ddb19790>, body: {"keypair": {"name": "tempest-TestShelveInstance-692947109", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB7xCexl6YZZDyNw3WZAIZRUwstTnv2qXrmfqRS9EL8mviZgLu3qCAXNTETc7/m8XDCQM4I3dfpb6TbRUZajaaASBDQquoFjZifHiJmKmP2yUoJc3tg3ZOXuOrxMRd2+/g=="}} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:12:40.995520 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.quota [None req-0a539e52-534d-4a2e-8291-7d3932812dc5 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Getting quotas for project 5577bdb690df49f899cfa0f47ad5ba5c. Resources: {'key_pairs'} {{(pid=117858) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 07:12:41.001883 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.quota [None req-0a539e52-534d-4a2e-8291-7d3932812dc5 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Getting quotas for user 062a94c1e6be4695b9758287aa82ab41 and project 5577bdb690df49f899cfa0f47ad5ba5c. Resources: {'key_pairs'} {{(pid=117858) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 07:12:41.028819 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-0a539e52-534d-4a2e-8291-7d3932812dc5 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.289818 Aug 09 07:12:41.029422 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 449/901] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 9 07:12:40 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:12:56.140524 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 07:12:56.141011 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Tue Aug 9 07:12:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 07:12:56.188505 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2cd54704-f4d5-405d-b5ff-2852873f1eea tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-79960490", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-692947109", "security_groups": [{"name": "tempest-secgroup-smoke-1784749473"}], "networks": [{"uuid": "a3700f0d-c38a-4e3a-aa56-80e1ef6a7d80"}], "block_device_mapping_v2": [{"uuid": "3f9a5ed0-29e2-4e49-be6b-7537e0f3e6ea", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:12:56.199044 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=8 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:12:56.199694 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:12:56.421376 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.network.neutron [None req-2cd54704-f4d5-405d-b5ff-2852873f1eea tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] validate_networks() for [('a3700f0d-c38a-4e3a-aa56-80e1ef6a7d80', None, None, None, None, None)] {{(pid=117859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 07:12:56.795372 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-2cd54704-f4d5-405d-b5ff-2852873f1eea tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Flavor limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 07:12:56.795832 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-2cd54704-f4d5-405d-b5ff-2852873f1eea tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Image limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 07:12:56.796316 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-2cd54704-f4d5-405d-b5ff-2852873f1eea tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Flavor pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 07:12:56.796730 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-2cd54704-f4d5-405d-b5ff-2852873f1eea tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Image pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 07:12:56.797144 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-2cd54704-f4d5-405d-b5ff-2852873f1eea tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 07:12:56.805858 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2cd54704-f4d5-405d-b5ff-2852873f1eea tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:12:56.806340 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2cd54704-f4d5-405d-b5ff-2852873f1eea tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:12:56.806775 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2cd54704-f4d5-405d-b5ff-2852873f1eea tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:12:56.807501 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2cd54704-f4d5-405d-b5ff-2852873f1eea tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:12:56.807987 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2cd54704-f4d5-405d-b5ff-2852873f1eea tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:12:56.808414 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2cd54704-f4d5-405d-b5ff-2852873f1eea tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:12:56.825380 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-2cd54704-f4d5-405d-b5ff-2852873f1eea tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Getting quotas for project 5577bdb690df49f899cfa0f47ad5ba5c. Resources: {'cores', 'instances', 'ram'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 07:12:56.829386 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-2cd54704-f4d5-405d-b5ff-2852873f1eea tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Getting quotas for user 062a94c1e6be4695b9758287aa82ab41 and project 5577bdb690df49f899cfa0f47ad5ba5c. Resources: {'cores', 'instances', 'ram'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 07:12:56.887134 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-2cd54704-f4d5-405d-b5ff-2852873f1eea tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Going to run 1 instances... {{(pid=117859) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 07:12:56.889630 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-2cd54704-f4d5-405d-b5ff-2852873f1eea tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] [instance: 95ddb0e7-05cc-483c-8500-493ded6e2dd4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3f9a5ed0-29e2-4e49-be6b-7537e0f3e6ea',volume_size=None,volume_type=None)] {{(pid=117859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 07:12:57.016265 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-2cd54704-f4d5-405d-b5ff-2852873f1eea tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.832068 Aug 09 07:12:57.016894 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 453/902] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 9 07:12:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 07:12:57.025152 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_cell0:SELECT=4 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:12:57.026053 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:12:57.030635 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-c6ca6abb-7824-4a0f-b179-3e45c228a800 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:12:57.031691 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-c6ca6abb-7824-4a0f-b179-3e45c228a800 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] [instance: 95ddb0e7-05cc-483c-8500-493ded6e2dd4] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:12:57.184214 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-c6ca6abb-7824-4a0f-b179-3e45c228a800 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062a94c1e6be4695b9758287aa82ab41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577bdb690df49f899cfa0f47ad5ba5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:12:57.191924 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-c6ca6abb-7824-4a0f-b179-3e45c228a800 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] 10.222.0.30 "GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4" status: 200 len: 1086 microversion: 2.1 time: 0.168157 Aug 09 07:12:57.192469 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 450/903] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:12:57 2022] GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4 => generated 1086 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:12:58.214326 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-bf48e809-481f-41a0-89e6-89993174b702 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:12:58.214964 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-bf48e809-481f-41a0-89e6-89993174b702 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] [instance: 95ddb0e7-05cc-483c-8500-493ded6e2dd4] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:12:58.221900 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bf48e809-481f-41a0-89e6-89993174b702 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:12:58.222396 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bf48e809-481f-41a0-89e6-89993174b702 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:12:58.222837 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bf48e809-481f-41a0-89e6-89993174b702 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:12:58.223551 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bf48e809-481f-41a0-89e6-89993174b702 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:12:58.224043 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bf48e809-481f-41a0-89e6-89993174b702 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:12:58.224473 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bf48e809-481f-41a0-89e6-89993174b702 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:12:58.289606 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-bf48e809-481f-41a0-89e6-89993174b702 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062a94c1e6be4695b9758287aa82ab41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577bdb690df49f899cfa0f47ad5ba5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:12:58.297320 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-bf48e809-481f-41a0-89e6-89993174b702 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] 10.222.0.30 "GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4" status: 200 len: 1202 microversion: 2.1 time: 0.087326 Aug 09 07:12:58.297914 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 454/904] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:12:58 2022] GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4 => generated 1202 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:12:59.318391 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-dfba47b5-df1b-497e-862b-fcc06fbde281 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:12:59.319094 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-dfba47b5-df1b-497e-862b-fcc06fbde281 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] [instance: 95ddb0e7-05cc-483c-8500-493ded6e2dd4] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:12:59.326128 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-dfba47b5-df1b-497e-862b-fcc06fbde281 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:12:59.326714 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-dfba47b5-df1b-497e-862b-fcc06fbde281 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:12:59.327166 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-dfba47b5-df1b-497e-862b-fcc06fbde281 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:12:59.327903 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-dfba47b5-df1b-497e-862b-fcc06fbde281 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:12:59.328363 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-dfba47b5-df1b-497e-862b-fcc06fbde281 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:12:59.328788 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-dfba47b5-df1b-497e-862b-fcc06fbde281 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:12:59.459179 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-8428a97e-d6ba-409d-83a8-23cf1025dda4 req-2e98644f-f3ed-44b4-aba2-964c335c6123 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95ddb0e7-05cc-483c-8500-493ded6e2dd4", "tag": "f0efce78-5257-411a-8a3f-ddd3e3f7cd43"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:12:59.465748 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-dfba47b5-df1b-497e-862b-fcc06fbde281 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062a94c1e6be4695b9758287aa82ab41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577bdb690df49f899cfa0f47ad5ba5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:12:59.470625 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-8428a97e-d6ba-409d-83a8-23cf1025dda4 req-2e98644f-f3ed-44b4-aba2-964c335c6123 service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:12:59.471039 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-8428a97e-d6ba-409d-83a8-23cf1025dda4 req-2e98644f-f3ed-44b4-aba2-964c335c6123 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:12:59.474046 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-dfba47b5-df1b-497e-862b-fcc06fbde281 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] 10.222.0.30 "GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4" status: 200 len: 1258 microversion: 2.1 time: 0.159473 Aug 09 07:12:59.474547 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-8428a97e-d6ba-409d-83a8-23cf1025dda4 req-2e98644f-f3ed-44b4-aba2-964c335c6123 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:12:59.487790 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 451/905] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:12:59 2022] GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4 => generated 1258 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:12:59.500533 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-8428a97e-d6ba-409d-83a8-23cf1025dda4 req-2e98644f-f3ed-44b4-aba2-964c335c6123 service nova] Creating event network-changed:f0efce78-5257-411a-8a3f-ddd3e3f7cd43 for instance 95ddb0e7-05cc-483c-8500-493ded6e2dd4 on hv-cinder-85251 Aug 09 07:12:59.505634 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-8428a97e-d6ba-409d-83a8-23cf1025dda4 req-2e98644f-f3ed-44b4-aba2-964c335c6123 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050732 Aug 09 07:12:59.506992 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 455/906] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:13:00.494037 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-d0315b71-7178-4e5f-8ab5-0b6739edd968 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:13:00.494643 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-d0315b71-7178-4e5f-8ab5-0b6739edd968 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] [instance: 95ddb0e7-05cc-483c-8500-493ded6e2dd4] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:13:00.501560 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d0315b71-7178-4e5f-8ab5-0b6739edd968 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:13:00.502042 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d0315b71-7178-4e5f-8ab5-0b6739edd968 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:13:00.502468 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d0315b71-7178-4e5f-8ab5-0b6739edd968 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:13:00.503154 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d0315b71-7178-4e5f-8ab5-0b6739edd968 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:13:00.503621 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d0315b71-7178-4e5f-8ab5-0b6739edd968 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:13:00.504038 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d0315b71-7178-4e5f-8ab5-0b6739edd968 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:13:00.636295 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-d0315b71-7178-4e5f-8ab5-0b6739edd968 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062a94c1e6be4695b9758287aa82ab41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577bdb690df49f899cfa0f47ad5ba5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:13:00.644355 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-d0315b71-7178-4e5f-8ab5-0b6739edd968 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] 10.222.0.30 "GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4" status: 200 len: 1258 microversion: 2.1 time: 0.154075 Aug 09 07:13:00.644916 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 452/907] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:13:00 2022] GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4 => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:13:01.666035 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-74a88a8e-a314-4760-b010-fde7b47b86f8 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:13:01.666728 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-74a88a8e-a314-4760-b010-fde7b47b86f8 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] [instance: 95ddb0e7-05cc-483c-8500-493ded6e2dd4] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:13:01.673522 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-74a88a8e-a314-4760-b010-fde7b47b86f8 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:13:01.674001 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-74a88a8e-a314-4760-b010-fde7b47b86f8 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:13:01.674438 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-74a88a8e-a314-4760-b010-fde7b47b86f8 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:13:01.675131 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-74a88a8e-a314-4760-b010-fde7b47b86f8 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:13:01.675584 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-74a88a8e-a314-4760-b010-fde7b47b86f8 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:13:01.676033 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-74a88a8e-a314-4760-b010-fde7b47b86f8 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:13:01.812083 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-74a88a8e-a314-4760-b010-fde7b47b86f8 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062a94c1e6be4695b9758287aa82ab41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577bdb690df49f899cfa0f47ad5ba5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:13:01.819461 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-74a88a8e-a314-4760-b010-fde7b47b86f8 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] 10.222.0.30 "GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4" status: 200 len: 1258 microversion: 2.1 time: 0.158100 Aug 09 07:13:01.820064 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 456/908] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:13:01 2022] GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4 => generated 1258 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:13:02.840543 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-6569e4ee-2e69-43f5-98fe-7c68f41ec8be tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:13:02.841419 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-6569e4ee-2e69-43f5-98fe-7c68f41ec8be tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] [instance: 95ddb0e7-05cc-483c-8500-493ded6e2dd4] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:13:02.847796 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6569e4ee-2e69-43f5-98fe-7c68f41ec8be tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:13:02.848276 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6569e4ee-2e69-43f5-98fe-7c68f41ec8be tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:13:02.848704 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6569e4ee-2e69-43f5-98fe-7c68f41ec8be tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:13:02.849393 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6569e4ee-2e69-43f5-98fe-7c68f41ec8be tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:13:02.849846 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6569e4ee-2e69-43f5-98fe-7c68f41ec8be tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:13:02.850271 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6569e4ee-2e69-43f5-98fe-7c68f41ec8be tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:13:02.980179 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-6569e4ee-2e69-43f5-98fe-7c68f41ec8be tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062a94c1e6be4695b9758287aa82ab41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577bdb690df49f899cfa0f47ad5ba5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:13:02.988287 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-6569e4ee-2e69-43f5-98fe-7c68f41ec8be tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] 10.222.0.30 "GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4" status: 200 len: 1258 microversion: 2.1 time: 0.151669 Aug 09 07:13:02.988847 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 453/909] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:13:02 2022] GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4 => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:13:04.009282 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6da880ee-1e6a-49a0-bf61-df7569019d3e tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:13:04.009893 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-6da880ee-1e6a-49a0-bf61-df7569019d3e tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] [instance: 95ddb0e7-05cc-483c-8500-493ded6e2dd4] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:13:04.016560 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6da880ee-1e6a-49a0-bf61-df7569019d3e tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:13:04.017033 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6da880ee-1e6a-49a0-bf61-df7569019d3e tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:13:04.017465 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6da880ee-1e6a-49a0-bf61-df7569019d3e tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:13:04.018150 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6da880ee-1e6a-49a0-bf61-df7569019d3e tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:13:04.018600 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6da880ee-1e6a-49a0-bf61-df7569019d3e tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:13:04.019020 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6da880ee-1e6a-49a0-bf61-df7569019d3e tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:13:04.147454 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6da880ee-1e6a-49a0-bf61-df7569019d3e tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062a94c1e6be4695b9758287aa82ab41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577bdb690df49f899cfa0f47ad5ba5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:13:04.155618 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-6da880ee-1e6a-49a0-bf61-df7569019d3e tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] 10.222.0.30 "GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4" status: 200 len: 1258 microversion: 2.1 time: 0.150183 Aug 09 07:13:04.156198 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 457/910] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:13:04 2022] GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4 => generated 1258 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:13:05.175954 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-120f5806-23d0-4ef0-b900-53cae0351d96 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:13:05.176573 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-120f5806-23d0-4ef0-b900-53cae0351d96 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] [instance: 95ddb0e7-05cc-483c-8500-493ded6e2dd4] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:13:05.182827 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-120f5806-23d0-4ef0-b900-53cae0351d96 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:13:05.183303 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-120f5806-23d0-4ef0-b900-53cae0351d96 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:13:05.183767 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-120f5806-23d0-4ef0-b900-53cae0351d96 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:13:05.185180 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-120f5806-23d0-4ef0-b900-53cae0351d96 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:13:05.185627 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-120f5806-23d0-4ef0-b900-53cae0351d96 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:13:05.186047 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-120f5806-23d0-4ef0-b900-53cae0351d96 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:13:05.319669 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-120f5806-23d0-4ef0-b900-53cae0351d96 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062a94c1e6be4695b9758287aa82ab41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577bdb690df49f899cfa0f47ad5ba5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:13:05.327067 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-120f5806-23d0-4ef0-b900-53cae0351d96 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] 10.222.0.30 "GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4" status: 200 len: 1258 microversion: 2.1 time: 0.155054 Aug 09 07:13:05.327653 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 454/911] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:13:05 2022] GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4 => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:13:06.346806 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e5735d68-16d2-4529-94f4-7f465ddb2bc2 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:13:06.347422 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-e5735d68-16d2-4529-94f4-7f465ddb2bc2 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] [instance: 95ddb0e7-05cc-483c-8500-493ded6e2dd4] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:13:06.353874 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e5735d68-16d2-4529-94f4-7f465ddb2bc2 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:13:06.354355 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e5735d68-16d2-4529-94f4-7f465ddb2bc2 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:13:06.354794 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e5735d68-16d2-4529-94f4-7f465ddb2bc2 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:13:06.355487 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e5735d68-16d2-4529-94f4-7f465ddb2bc2 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:13:06.356542 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e5735d68-16d2-4529-94f4-7f465ddb2bc2 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:13:06.356967 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e5735d68-16d2-4529-94f4-7f465ddb2bc2 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:13:06.487911 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e5735d68-16d2-4529-94f4-7f465ddb2bc2 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062a94c1e6be4695b9758287aa82ab41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577bdb690df49f899cfa0f47ad5ba5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:13:06.495368 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-e5735d68-16d2-4529-94f4-7f465ddb2bc2 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] 10.222.0.30 "GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4" status: 200 len: 1258 microversion: 2.1 time: 0.152484 Aug 09 07:13:06.495957 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 458/912] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:13:06 2022] GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4 => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:13:07.517982 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-5b0017e4-3a28-4b26-a4c5-e11fcf07b7e8 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:13:07.518365 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-5b0017e4-3a28-4b26-a4c5-e11fcf07b7e8 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] [instance: 95ddb0e7-05cc-483c-8500-493ded6e2dd4] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:13:07.521837 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_cell0:SELECT=2 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:13:07.525959 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5b0017e4-3a28-4b26-a4c5-e11fcf07b7e8 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:13:07.526441 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5b0017e4-3a28-4b26-a4c5-e11fcf07b7e8 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:13:07.526879 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5b0017e4-3a28-4b26-a4c5-e11fcf07b7e8 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:13:07.527574 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5b0017e4-3a28-4b26-a4c5-e11fcf07b7e8 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:13:07.528171 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5b0017e4-3a28-4b26-a4c5-e11fcf07b7e8 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:13:07.528600 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5b0017e4-3a28-4b26-a4c5-e11fcf07b7e8 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:13:07.662747 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-5b0017e4-3a28-4b26-a4c5-e11fcf07b7e8 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062a94c1e6be4695b9758287aa82ab41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577bdb690df49f899cfa0f47ad5ba5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:13:07.670317 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-5b0017e4-3a28-4b26-a4c5-e11fcf07b7e8 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] 10.222.0.30 "GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4" status: 200 len: 1258 microversion: 2.1 time: 0.156448 Aug 09 07:13:07.671117 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 455/913] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:13:07 2022] GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4 => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:13:08.690305 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-fbe98755-53e6-4708-bc50-6fd5804c0734 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:13:08.690916 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-fbe98755-53e6-4708-bc50-6fd5804c0734 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] [instance: 95ddb0e7-05cc-483c-8500-493ded6e2dd4] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:13:08.692867 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=2 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:13:08.693634 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=6 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:13:08.701313 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fbe98755-53e6-4708-bc50-6fd5804c0734 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:13:08.701795 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fbe98755-53e6-4708-bc50-6fd5804c0734 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:13:08.702229 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fbe98755-53e6-4708-bc50-6fd5804c0734 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:13:08.702919 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fbe98755-53e6-4708-bc50-6fd5804c0734 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:13:08.703374 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fbe98755-53e6-4708-bc50-6fd5804c0734 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:13:08.703834 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fbe98755-53e6-4708-bc50-6fd5804c0734 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:13:08.832163 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-fbe98755-53e6-4708-bc50-6fd5804c0734 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062a94c1e6be4695b9758287aa82ab41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577bdb690df49f899cfa0f47ad5ba5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:13:08.839883 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-fbe98755-53e6-4708-bc50-6fd5804c0734 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] 10.222.0.30 "GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4" status: 200 len: 1258 microversion: 2.1 time: 0.153447 Aug 09 07:13:08.841090 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 459/914] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:13:08 2022] GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4 => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:13:09.229177 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [req-af8ca430-0c2c-4fde-bb1f-bae7aa85fe16 req-909364d2-d591-4319-a1b4-bc2a047e00f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95ddb0e7-05cc-483c-8500-493ded6e2dd4", "name": "network-vif-plugged", "status": "completed", "tag": "f0efce78-5257-411a-8a3f-ddd3e3f7cd43"}]} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:13:09.240539 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-af8ca430-0c2c-4fde-bb1f-bae7aa85fe16 req-909364d2-d591-4319-a1b4-bc2a047e00f4 service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:13:09.240973 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-af8ca430-0c2c-4fde-bb1f-bae7aa85fe16 req-909364d2-d591-4319-a1b4-bc2a047e00f4 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:13:09.241445 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-af8ca430-0c2c-4fde-bb1f-bae7aa85fe16 req-909364d2-d591-4319-a1b4-bc2a047e00f4 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:13:09.253608 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.compute.server_external_events [req-af8ca430-0c2c-4fde-bb1f-bae7aa85fe16 req-909364d2-d591-4319-a1b4-bc2a047e00f4 service nova] Creating event network-vif-plugged:f0efce78-5257-411a-8a3f-ddd3e3f7cd43 for instance 95ddb0e7-05cc-483c-8500-493ded6e2dd4 on hv-cinder-85251 Aug 09 07:13:09.258492 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [req-af8ca430-0c2c-4fde-bb1f-bae7aa85fe16 req-909364d2-d591-4319-a1b4-bc2a047e00f4 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033304 Aug 09 07:13:09.259079 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 456/915] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:13:09.861310 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-119f2908-39c6-4745-b52b-cc57680ec75b tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:13:09.861917 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-119f2908-39c6-4745-b52b-cc57680ec75b tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] [instance: 95ddb0e7-05cc-483c-8500-493ded6e2dd4] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:13:09.868300 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-119f2908-39c6-4745-b52b-cc57680ec75b tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:13:09.868896 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-119f2908-39c6-4745-b52b-cc57680ec75b tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:13:09.869328 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-119f2908-39c6-4745-b52b-cc57680ec75b tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:13:09.870035 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-119f2908-39c6-4745-b52b-cc57680ec75b tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:13:09.870483 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-119f2908-39c6-4745-b52b-cc57680ec75b tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:13:09.870899 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-119f2908-39c6-4745-b52b-cc57680ec75b tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:13:10.001467 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-119f2908-39c6-4745-b52b-cc57680ec75b tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062a94c1e6be4695b9758287aa82ab41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577bdb690df49f899cfa0f47ad5ba5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:13:10.008867 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-119f2908-39c6-4745-b52b-cc57680ec75b tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] 10.222.0.30 "GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4" status: 200 len: 1258 microversion: 2.1 time: 0.151401 Aug 09 07:13:10.009418 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 460/916] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:13:09 2022] GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4 => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:13:11.031110 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-3dba4703-dad8-4490-b52f-21b445facba4 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:13:11.031857 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-3dba4703-dad8-4490-b52f-21b445facba4 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] [instance: 95ddb0e7-05cc-483c-8500-493ded6e2dd4] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:13:11.037973 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3dba4703-dad8-4490-b52f-21b445facba4 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:13:11.038459 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3dba4703-dad8-4490-b52f-21b445facba4 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:13:11.038919 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3dba4703-dad8-4490-b52f-21b445facba4 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:13:11.039592 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3dba4703-dad8-4490-b52f-21b445facba4 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:13:11.040078 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3dba4703-dad8-4490-b52f-21b445facba4 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:13:11.040506 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3dba4703-dad8-4490-b52f-21b445facba4 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:13:11.172151 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-3dba4703-dad8-4490-b52f-21b445facba4 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062a94c1e6be4695b9758287aa82ab41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577bdb690df49f899cfa0f47ad5ba5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:13:11.179617 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-3dba4703-dad8-4490-b52f-21b445facba4 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] 10.222.0.30 "GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4" status: 200 len: 1442 microversion: 2.1 time: 0.153509 Aug 09 07:13:11.180202 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 457/917] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:13:11 2022] GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4 => generated 1442 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:13:11.200468 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c8f8143d-f78c-443c-a778-2346f0037992 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:13:11.201086 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c8f8143d-f78c-443c-a778-2346f0037992 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] [instance: 95ddb0e7-05cc-483c-8500-493ded6e2dd4] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:13:11.207356 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c8f8143d-f78c-443c-a778-2346f0037992 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:13:11.207871 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c8f8143d-f78c-443c-a778-2346f0037992 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:13:11.208308 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c8f8143d-f78c-443c-a778-2346f0037992 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:13:11.208993 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c8f8143d-f78c-443c-a778-2346f0037992 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:13:11.209445 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c8f8143d-f78c-443c-a778-2346f0037992 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:13:11.209864 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c8f8143d-f78c-443c-a778-2346f0037992 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:13:11.340905 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c8f8143d-f78c-443c-a778-2346f0037992 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062a94c1e6be4695b9758287aa82ab41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577bdb690df49f899cfa0f47ad5ba5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:13:11.348399 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c8f8143d-f78c-443c-a778-2346f0037992 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] 10.222.0.30 "GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4" status: 200 len: 1442 microversion: 2.1 time: 0.152357 Aug 09 07:13:11.348961 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 461/918] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:13:11 2022] GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4 => generated 1442 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:13:13.189949 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [req-3c05494b-152d-4cc0-a776-dff39c53c66a req-cbdff6ac-247f-47a1-8f51-75fabdf3696b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95ddb0e7-05cc-483c-8500-493ded6e2dd4", "tag": "f0efce78-5257-411a-8a3f-ddd3e3f7cd43"}]} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:13:13.199449 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-3c05494b-152d-4cc0-a776-dff39c53c66a req-cbdff6ac-247f-47a1-8f51-75fabdf3696b service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:13:13.199957 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-3c05494b-152d-4cc0-a776-dff39c53c66a req-cbdff6ac-247f-47a1-8f51-75fabdf3696b service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:13:13.200538 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-3c05494b-152d-4cc0-a776-dff39c53c66a req-cbdff6ac-247f-47a1-8f51-75fabdf3696b service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:13:13.211254 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.compute.server_external_events [req-3c05494b-152d-4cc0-a776-dff39c53c66a req-cbdff6ac-247f-47a1-8f51-75fabdf3696b service nova] Creating event network-changed:f0efce78-5257-411a-8a3f-ddd3e3f7cd43 for instance 95ddb0e7-05cc-483c-8500-493ded6e2dd4 on hv-cinder-85251 Aug 09 07:13:13.216523 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [req-3c05494b-152d-4cc0-a776-dff39c53c66a req-cbdff6ac-247f-47a1-8f51-75fabdf3696b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030149 Aug 09 07:13:13.217128 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 458/919] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:14:19.957452 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 07:14:19.958075 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Tue Aug 9 07:14:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 07:14:20.464484 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 07:14:20.464949 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Tue Aug 9 07:14:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 07:15:08.289356 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:15:08.290108 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=46 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:15:08.294163 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-9d1df0e1-f766-4558-9646-5856f1c314b9 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:15:08.294695 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-9d1df0e1-f766-4558-9646-5856f1c314b9 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] [instance: 95ddb0e7-05cc-483c-8500-493ded6e2dd4] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:15:08.302413 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9d1df0e1-f766-4558-9646-5856f1c314b9 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:15:08.302898 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9d1df0e1-f766-4558-9646-5856f1c314b9 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:15:08.303335 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9d1df0e1-f766-4558-9646-5856f1c314b9 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:15:08.304064 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9d1df0e1-f766-4558-9646-5856f1c314b9 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:15:08.304519 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9d1df0e1-f766-4558-9646-5856f1c314b9 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:15:08.304945 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9d1df0e1-f766-4558-9646-5856f1c314b9 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:15:08.327655 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.objects.instance [None req-9d1df0e1-f766-4558-9646-5856f1c314b9 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lazy-loading 'flavor' on Instance uuid 95ddb0e7-05cc-483c-8500-493ded6e2dd4 {{(pid=117859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 07:15:08.397959 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-9d1df0e1-f766-4558-9646-5856f1c314b9 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] 10.222.0.30 "POST /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4/action" status: 202 len: 0 microversion: 2.1 time: 0.110211 Aug 09 07:15:08.398540 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 462/920] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 9 07:15:08 2022] POST /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 07:15:08.405832 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_api:SELECT=20 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:15:08.406584 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_cell1:SELECT=40 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:15:08.411735 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-c6dfda46-7b19-4327-98b5-65e4116e5f94 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:15:08.412440 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-c6dfda46-7b19-4327-98b5-65e4116e5f94 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] [instance: 95ddb0e7-05cc-483c-8500-493ded6e2dd4] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:15:08.421216 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c6dfda46-7b19-4327-98b5-65e4116e5f94 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:15:08.421697 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c6dfda46-7b19-4327-98b5-65e4116e5f94 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:15:08.422127 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c6dfda46-7b19-4327-98b5-65e4116e5f94 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:15:08.422819 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c6dfda46-7b19-4327-98b5-65e4116e5f94 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:15:08.423484 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c6dfda46-7b19-4327-98b5-65e4116e5f94 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:15:08.423987 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c6dfda46-7b19-4327-98b5-65e4116e5f94 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:15:08.562966 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-c6dfda46-7b19-4327-98b5-65e4116e5f94 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062a94c1e6be4695b9758287aa82ab41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577bdb690df49f899cfa0f47ad5ba5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:15:08.570709 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-c6dfda46-7b19-4327-98b5-65e4116e5f94 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] 10.222.0.30 "GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4" status: 200 len: 1567 microversion: 2.1 time: 0.167815 Aug 09 07:15:08.571266 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 459/921] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:15:08 2022] GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:15:09.595411 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-ce23d97b-3f4e-4fb9-93b1-a796572aee7c tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:15:09.596479 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-ce23d97b-3f4e-4fb9-93b1-a796572aee7c tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] [instance: 95ddb0e7-05cc-483c-8500-493ded6e2dd4] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:15:09.602654 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ce23d97b-3f4e-4fb9-93b1-a796572aee7c tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:15:09.603128 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ce23d97b-3f4e-4fb9-93b1-a796572aee7c tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:15:09.603556 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ce23d97b-3f4e-4fb9-93b1-a796572aee7c tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:15:09.604260 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ce23d97b-3f4e-4fb9-93b1-a796572aee7c tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:15:09.604709 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ce23d97b-3f4e-4fb9-93b1-a796572aee7c tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:15:09.605124 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ce23d97b-3f4e-4fb9-93b1-a796572aee7c tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:15:09.734815 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ce23d97b-3f4e-4fb9-93b1-a796572aee7c tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062a94c1e6be4695b9758287aa82ab41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577bdb690df49f899cfa0f47ad5ba5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:15:09.743211 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-ce23d97b-3f4e-4fb9-93b1-a796572aee7c tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] 10.222.0.30 "GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4" status: 200 len: 1567 microversion: 2.1 time: 0.153081 Aug 09 07:15:09.743822 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 463/922] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:15:09 2022] GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:15:10.765019 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-505fac95-247f-46cb-8dd4-07171a34fd11 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:15:10.765610 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-505fac95-247f-46cb-8dd4-07171a34fd11 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] [instance: 95ddb0e7-05cc-483c-8500-493ded6e2dd4] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:15:10.772064 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-505fac95-247f-46cb-8dd4-07171a34fd11 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:15:10.772543 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-505fac95-247f-46cb-8dd4-07171a34fd11 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:15:10.772977 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-505fac95-247f-46cb-8dd4-07171a34fd11 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:15:10.773662 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-505fac95-247f-46cb-8dd4-07171a34fd11 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:15:10.774147 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-505fac95-247f-46cb-8dd4-07171a34fd11 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:15:10.774570 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-505fac95-247f-46cb-8dd4-07171a34fd11 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:15:10.906695 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-505fac95-247f-46cb-8dd4-07171a34fd11 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062a94c1e6be4695b9758287aa82ab41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577bdb690df49f899cfa0f47ad5ba5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:15:10.914162 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-505fac95-247f-46cb-8dd4-07171a34fd11 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] 10.222.0.30 "GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4" status: 200 len: 1567 microversion: 2.1 time: 0.153074 Aug 09 07:15:10.914716 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 460/923] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:15:10 2022] GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:15:11.935426 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-8668ce95-1922-43d6-97ac-ba6693dcbd14 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:15:11.936061 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-8668ce95-1922-43d6-97ac-ba6693dcbd14 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] [instance: 95ddb0e7-05cc-483c-8500-493ded6e2dd4] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:15:11.943364 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8668ce95-1922-43d6-97ac-ba6693dcbd14 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:15:11.943862 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8668ce95-1922-43d6-97ac-ba6693dcbd14 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:15:11.944292 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8668ce95-1922-43d6-97ac-ba6693dcbd14 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:15:11.944972 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8668ce95-1922-43d6-97ac-ba6693dcbd14 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:15:11.945418 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8668ce95-1922-43d6-97ac-ba6693dcbd14 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:15:11.945851 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8668ce95-1922-43d6-97ac-ba6693dcbd14 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:15:12.075944 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8668ce95-1922-43d6-97ac-ba6693dcbd14 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062a94c1e6be4695b9758287aa82ab41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577bdb690df49f899cfa0f47ad5ba5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:15:12.084043 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-8668ce95-1922-43d6-97ac-ba6693dcbd14 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] 10.222.0.30 "GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4" status: 200 len: 1567 microversion: 2.1 time: 0.152467 Aug 09 07:15:12.084607 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 464/924] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:15:11 2022] GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:15:13.104974 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-cd8c62f1-ee27-46c4-b854-f6c073e1f055 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:15:13.105590 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-cd8c62f1-ee27-46c4-b854-f6c073e1f055 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] [instance: 95ddb0e7-05cc-483c-8500-493ded6e2dd4] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:15:13.111969 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cd8c62f1-ee27-46c4-b854-f6c073e1f055 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:15:13.112392 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cd8c62f1-ee27-46c4-b854-f6c073e1f055 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:15:13.112834 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cd8c62f1-ee27-46c4-b854-f6c073e1f055 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:15:13.113520 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cd8c62f1-ee27-46c4-b854-f6c073e1f055 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:15:13.113968 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cd8c62f1-ee27-46c4-b854-f6c073e1f055 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:15:13.114389 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-cd8c62f1-ee27-46c4-b854-f6c073e1f055 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:15:13.248418 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-cd8c62f1-ee27-46c4-b854-f6c073e1f055 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062a94c1e6be4695b9758287aa82ab41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577bdb690df49f899cfa0f47ad5ba5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:15:13.256663 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-cd8c62f1-ee27-46c4-b854-f6c073e1f055 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] 10.222.0.30 "GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4" status: 200 len: 1567 microversion: 2.1 time: 0.155544 Aug 09 07:15:13.257228 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 461/925] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:15:13 2022] GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:15:14.278532 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-caa6912a-eb2d-4441-972c-8cce66da4eb2 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:15:14.279152 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-caa6912a-eb2d-4441-972c-8cce66da4eb2 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] [instance: 95ddb0e7-05cc-483c-8500-493ded6e2dd4] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:15:14.286108 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-caa6912a-eb2d-4441-972c-8cce66da4eb2 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:15:14.286627 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-caa6912a-eb2d-4441-972c-8cce66da4eb2 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:15:14.287067 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-caa6912a-eb2d-4441-972c-8cce66da4eb2 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:15:14.287796 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-caa6912a-eb2d-4441-972c-8cce66da4eb2 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:15:14.288254 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-caa6912a-eb2d-4441-972c-8cce66da4eb2 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:15:14.288681 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-caa6912a-eb2d-4441-972c-8cce66da4eb2 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:15:14.418425 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-caa6912a-eb2d-4441-972c-8cce66da4eb2 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062a94c1e6be4695b9758287aa82ab41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577bdb690df49f899cfa0f47ad5ba5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:15:14.426080 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-caa6912a-eb2d-4441-972c-8cce66da4eb2 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] 10.222.0.30 "GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4" status: 200 len: 1567 microversion: 2.1 time: 0.151529 Aug 09 07:15:14.426639 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 465/926] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:15:14 2022] GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:15:15.447639 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-c5d6718c-2872-4295-a9b0-96155bed618e tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:15:15.448244 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-c5d6718c-2872-4295-a9b0-96155bed618e tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] [instance: 95ddb0e7-05cc-483c-8500-493ded6e2dd4] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:15:15.454457 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c5d6718c-2872-4295-a9b0-96155bed618e tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:15:15.454930 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c5d6718c-2872-4295-a9b0-96155bed618e tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:15:15.455391 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c5d6718c-2872-4295-a9b0-96155bed618e tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:15:15.456213 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c5d6718c-2872-4295-a9b0-96155bed618e tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:15:15.456658 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c5d6718c-2872-4295-a9b0-96155bed618e tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:15:15.457101 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-c5d6718c-2872-4295-a9b0-96155bed618e tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:15:15.584833 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-c5d6718c-2872-4295-a9b0-96155bed618e tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062a94c1e6be4695b9758287aa82ab41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577bdb690df49f899cfa0f47ad5ba5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:15:15.592226 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-c5d6718c-2872-4295-a9b0-96155bed618e tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] 10.222.0.30 "GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4" status: 200 len: 1567 microversion: 2.1 time: 0.148511 Aug 09 07:15:15.592787 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 462/927] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:15:15 2022] GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:15:16.614451 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-20607888-e2cc-4016-86b8-ab17e7941965 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:15:16.615056 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-20607888-e2cc-4016-86b8-ab17e7941965 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] [instance: 95ddb0e7-05cc-483c-8500-493ded6e2dd4] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:15:16.621463 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-20607888-e2cc-4016-86b8-ab17e7941965 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:15:16.621943 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-20607888-e2cc-4016-86b8-ab17e7941965 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:15:16.622374 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-20607888-e2cc-4016-86b8-ab17e7941965 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:15:16.623057 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-20607888-e2cc-4016-86b8-ab17e7941965 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:15:16.623515 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-20607888-e2cc-4016-86b8-ab17e7941965 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:15:16.623964 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-20607888-e2cc-4016-86b8-ab17e7941965 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:15:16.759250 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-20607888-e2cc-4016-86b8-ab17e7941965 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062a94c1e6be4695b9758287aa82ab41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577bdb690df49f899cfa0f47ad5ba5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:15:16.766757 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-20607888-e2cc-4016-86b8-ab17e7941965 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] 10.222.0.30 "GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4" status: 200 len: 1567 microversion: 2.1 time: 0.156776 Aug 09 07:15:16.767315 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 466/928] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:15:16 2022] GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:15:17.787945 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-31a1c241-3845-4cef-af81-27b0675a0257 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:15:17.788530 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-31a1c241-3845-4cef-af81-27b0675a0257 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] [instance: 95ddb0e7-05cc-483c-8500-493ded6e2dd4] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:15:17.794857 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-31a1c241-3845-4cef-af81-27b0675a0257 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:15:17.795332 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-31a1c241-3845-4cef-af81-27b0675a0257 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:15:17.795808 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-31a1c241-3845-4cef-af81-27b0675a0257 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:15:17.796502 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-31a1c241-3845-4cef-af81-27b0675a0257 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:15:17.796945 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-31a1c241-3845-4cef-af81-27b0675a0257 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:15:17.797359 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-31a1c241-3845-4cef-af81-27b0675a0257 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:15:17.926022 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-31a1c241-3845-4cef-af81-27b0675a0257 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062a94c1e6be4695b9758287aa82ab41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577bdb690df49f899cfa0f47ad5ba5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:15:17.933350 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-31a1c241-3845-4cef-af81-27b0675a0257 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] 10.222.0.30 "GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4" status: 200 len: 1567 microversion: 2.1 time: 0.149385 Aug 09 07:15:17.933904 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 463/929] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:15:17 2022] GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:15:18.954843 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d8389105-2b7b-4c83-b3fb-4d34863a9431 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:15:18.955452 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-d8389105-2b7b-4c83-b3fb-4d34863a9431 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] [instance: 95ddb0e7-05cc-483c-8500-493ded6e2dd4] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:15:18.962068 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d8389105-2b7b-4c83-b3fb-4d34863a9431 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:15:18.962547 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d8389105-2b7b-4c83-b3fb-4d34863a9431 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:15:18.962982 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d8389105-2b7b-4c83-b3fb-4d34863a9431 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:15:18.963695 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d8389105-2b7b-4c83-b3fb-4d34863a9431 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:15:18.964150 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d8389105-2b7b-4c83-b3fb-4d34863a9431 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:15:18.964574 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d8389105-2b7b-4c83-b3fb-4d34863a9431 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:15:19.100061 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d8389105-2b7b-4c83-b3fb-4d34863a9431 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062a94c1e6be4695b9758287aa82ab41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577bdb690df49f899cfa0f47ad5ba5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:15:19.108419 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-d8389105-2b7b-4c83-b3fb-4d34863a9431 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] 10.222.0.30 "GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4" status: 200 len: 1567 microversion: 2.1 time: 0.157419 Aug 09 07:15:19.108981 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 467/930] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:15:18 2022] GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:15:20.130753 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-22a557da-595f-4d44-b5b4-b184ca00fa19 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:15:20.131319 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-22a557da-595f-4d44-b5b4-b184ca00fa19 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] [instance: 95ddb0e7-05cc-483c-8500-493ded6e2dd4] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:15:20.137862 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-22a557da-595f-4d44-b5b4-b184ca00fa19 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:15:20.138339 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-22a557da-595f-4d44-b5b4-b184ca00fa19 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:15:20.138769 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-22a557da-595f-4d44-b5b4-b184ca00fa19 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:15:20.139453 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-22a557da-595f-4d44-b5b4-b184ca00fa19 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:15:20.139936 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-22a557da-595f-4d44-b5b4-b184ca00fa19 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:15:20.140360 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-22a557da-595f-4d44-b5b4-b184ca00fa19 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:15:20.271996 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-22a557da-595f-4d44-b5b4-b184ca00fa19 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062a94c1e6be4695b9758287aa82ab41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577bdb690df49f899cfa0f47ad5ba5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:15:20.279451 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-22a557da-595f-4d44-b5b4-b184ca00fa19 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] 10.222.0.30 "GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4" status: 200 len: 1567 microversion: 2.1 time: 0.153330 Aug 09 07:15:20.280044 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 464/931] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:15:20 2022] GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:15:21.300579 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-7024641c-38a3-4210-b922-1fde053b9d18 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:15:21.301210 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-7024641c-38a3-4210-b922-1fde053b9d18 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] [instance: 95ddb0e7-05cc-483c-8500-493ded6e2dd4] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:15:21.307648 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7024641c-38a3-4210-b922-1fde053b9d18 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:15:21.308140 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7024641c-38a3-4210-b922-1fde053b9d18 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:15:21.308578 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7024641c-38a3-4210-b922-1fde053b9d18 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:15:21.309275 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7024641c-38a3-4210-b922-1fde053b9d18 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:15:21.309731 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7024641c-38a3-4210-b922-1fde053b9d18 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:15:21.310155 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7024641c-38a3-4210-b922-1fde053b9d18 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:15:21.437809 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-7024641c-38a3-4210-b922-1fde053b9d18 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062a94c1e6be4695b9758287aa82ab41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577bdb690df49f899cfa0f47ad5ba5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:15:21.446084 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-7024641c-38a3-4210-b922-1fde053b9d18 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] 10.222.0.30 "GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4" status: 200 len: 1508 microversion: 2.1 time: 0.149528 Aug 09 07:15:21.446653 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 468/932] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:15:21 2022] GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:15:21.466790 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-409ef031-691d-4027-8e42-e455812e19e4 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:15:21.467381 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-409ef031-691d-4027-8e42-e455812e19e4 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] [instance: 95ddb0e7-05cc-483c-8500-493ded6e2dd4] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:15:21.474065 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-409ef031-691d-4027-8e42-e455812e19e4 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:15:21.474547 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-409ef031-691d-4027-8e42-e455812e19e4 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:15:21.474986 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-409ef031-691d-4027-8e42-e455812e19e4 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:15:21.475700 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-409ef031-691d-4027-8e42-e455812e19e4 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:15:21.476152 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-409ef031-691d-4027-8e42-e455812e19e4 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:15:21.476574 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-409ef031-691d-4027-8e42-e455812e19e4 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:15:21.517724 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-409ef031-691d-4027-8e42-e455812e19e4 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] [instance: 95ddb0e7-05cc-483c-8500-493ded6e2dd4] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117858) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 09 07:15:21.588297 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-409ef031-691d-4027-8e42-e455812e19e4 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] 10.222.0.30 "POST /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4/action" status: 202 len: 0 microversion: 2.1 time: 0.125306 Aug 09 07:15:21.588902 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 465/933] 10.222.0.30 () {60 vars in 1278 bytes} [Tue Aug 9 07:15:21 2022] POST /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 07:15:21.597048 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-bd7d2ae4-c4f3-48ac-b8e7-ac35b5b1c264 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:15:21.597659 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-bd7d2ae4-c4f3-48ac-b8e7-ac35b5b1c264 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] [instance: 95ddb0e7-05cc-483c-8500-493ded6e2dd4] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:15:21.604441 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bd7d2ae4-c4f3-48ac-b8e7-ac35b5b1c264 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:15:21.604916 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bd7d2ae4-c4f3-48ac-b8e7-ac35b5b1c264 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:15:21.605553 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bd7d2ae4-c4f3-48ac-b8e7-ac35b5b1c264 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:15:21.606433 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bd7d2ae4-c4f3-48ac-b8e7-ac35b5b1c264 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:15:21.606920 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bd7d2ae4-c4f3-48ac-b8e7-ac35b5b1c264 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:15:21.607363 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bd7d2ae4-c4f3-48ac-b8e7-ac35b5b1c264 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:15:21.782290 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-bd7d2ae4-c4f3-48ac-b8e7-ac35b5b1c264 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062a94c1e6be4695b9758287aa82ab41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577bdb690df49f899cfa0f47ad5ba5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:15:21.789905 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-bd7d2ae4-c4f3-48ac-b8e7-ac35b5b1c264 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] 10.222.0.30 "GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4" status: 200 len: 1516 microversion: 2.1 time: 0.196752 Aug 09 07:15:21.790478 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 469/934] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:15:21 2022] GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4 => generated 1516 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:15:22.811758 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-98b68565-0686-454b-9173-18ea29aa109b tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:15:22.812388 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-98b68565-0686-454b-9173-18ea29aa109b tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] [instance: 95ddb0e7-05cc-483c-8500-493ded6e2dd4] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:15:22.820658 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-98b68565-0686-454b-9173-18ea29aa109b tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:15:22.821149 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-98b68565-0686-454b-9173-18ea29aa109b tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:15:22.821586 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-98b68565-0686-454b-9173-18ea29aa109b tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:15:22.822289 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-98b68565-0686-454b-9173-18ea29aa109b tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:15:22.822741 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-98b68565-0686-454b-9173-18ea29aa109b tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:15:22.823184 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-98b68565-0686-454b-9173-18ea29aa109b tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:15:22.981506 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-98b68565-0686-454b-9173-18ea29aa109b tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062a94c1e6be4695b9758287aa82ab41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577bdb690df49f899cfa0f47ad5ba5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:15:22.989833 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-98b68565-0686-454b-9173-18ea29aa109b tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] 10.222.0.30 "GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4" status: 200 len: 1518 microversion: 2.1 time: 0.183434 Aug 09 07:15:22.990402 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 466/935] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:15:22 2022] GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4 => generated 1518 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:15:23.901027 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-fff620cf-d6d2-4b36-a1be-cac648ee23a2 req-256fd0c8-9717-4147-9dcf-0ddfd304d71a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95ddb0e7-05cc-483c-8500-493ded6e2dd4", "name": "network-vif-unplugged", "status": "completed", "tag": "f0efce78-5257-411a-8a3f-ddd3e3f7cd43"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:15:23.911060 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-fff620cf-d6d2-4b36-a1be-cac648ee23a2 req-256fd0c8-9717-4147-9dcf-0ddfd304d71a service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:15:23.911547 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-fff620cf-d6d2-4b36-a1be-cac648ee23a2 req-256fd0c8-9717-4147-9dcf-0ddfd304d71a service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:15:23.912007 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-fff620cf-d6d2-4b36-a1be-cac648ee23a2 req-256fd0c8-9717-4147-9dcf-0ddfd304d71a service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:15:23.923270 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-fff620cf-d6d2-4b36-a1be-cac648ee23a2 req-256fd0c8-9717-4147-9dcf-0ddfd304d71a service nova] Creating event network-vif-unplugged:f0efce78-5257-411a-8a3f-ddd3e3f7cd43 for instance 95ddb0e7-05cc-483c-8500-493ded6e2dd4 on hv-cinder-85251 Aug 09 07:15:23.928137 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-fff620cf-d6d2-4b36-a1be-cac648ee23a2 req-256fd0c8-9717-4147-9dcf-0ddfd304d71a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090687 Aug 09 07:15:23.928728 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 470/936] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:15:24.013430 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-22bfbeac-e347-49a6-b9f2-267cdc353e91 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:15:24.014068 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-22bfbeac-e347-49a6-b9f2-267cdc353e91 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] [instance: 95ddb0e7-05cc-483c-8500-493ded6e2dd4] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:15:24.020727 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-22bfbeac-e347-49a6-b9f2-267cdc353e91 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:15:24.021294 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-22bfbeac-e347-49a6-b9f2-267cdc353e91 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:15:24.021727 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-22bfbeac-e347-49a6-b9f2-267cdc353e91 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:15:24.022409 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-22bfbeac-e347-49a6-b9f2-267cdc353e91 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:15:24.022855 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-22bfbeac-e347-49a6-b9f2-267cdc353e91 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:15:24.023272 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-22bfbeac-e347-49a6-b9f2-267cdc353e91 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:15:24.150454 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-22bfbeac-e347-49a6-b9f2-267cdc353e91 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062a94c1e6be4695b9758287aa82ab41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577bdb690df49f899cfa0f47ad5ba5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:15:24.157977 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-22bfbeac-e347-49a6-b9f2-267cdc353e91 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] 10.222.0.30 "GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4" status: 200 len: 1574 microversion: 2.1 time: 0.148453 Aug 09 07:15:24.158540 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 467/937] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:15:24 2022] GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4 => generated 1574 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:15:25.180612 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6e7c9b48-3d2d-4135-afa5-11a7840fa380 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:15:25.181301 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-6e7c9b48-3d2d-4135-afa5-11a7840fa380 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] [instance: 95ddb0e7-05cc-483c-8500-493ded6e2dd4] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:15:25.187349 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6e7c9b48-3d2d-4135-afa5-11a7840fa380 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:15:25.187855 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6e7c9b48-3d2d-4135-afa5-11a7840fa380 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:15:25.188286 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6e7c9b48-3d2d-4135-afa5-11a7840fa380 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:15:25.188972 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6e7c9b48-3d2d-4135-afa5-11a7840fa380 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:15:25.189420 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6e7c9b48-3d2d-4135-afa5-11a7840fa380 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:15:25.189838 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6e7c9b48-3d2d-4135-afa5-11a7840fa380 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:15:25.324063 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6e7c9b48-3d2d-4135-afa5-11a7840fa380 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062a94c1e6be4695b9758287aa82ab41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577bdb690df49f899cfa0f47ad5ba5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:15:25.331573 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-6e7c9b48-3d2d-4135-afa5-11a7840fa380 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] 10.222.0.30 "GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4" status: 200 len: 1574 microversion: 2.1 time: 0.155755 Aug 09 07:15:25.332150 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 471/938] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:15:25 2022] GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4 => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:15:26.353793 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-d1b6d807-f696-4669-a537-1692f29818b1 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:15:26.354390 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-d1b6d807-f696-4669-a537-1692f29818b1 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] [instance: 95ddb0e7-05cc-483c-8500-493ded6e2dd4] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:15:26.360785 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d1b6d807-f696-4669-a537-1692f29818b1 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:15:26.361269 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d1b6d807-f696-4669-a537-1692f29818b1 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:15:26.361703 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d1b6d807-f696-4669-a537-1692f29818b1 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:15:26.362387 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d1b6d807-f696-4669-a537-1692f29818b1 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:15:26.362838 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d1b6d807-f696-4669-a537-1692f29818b1 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:15:26.363257 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d1b6d807-f696-4669-a537-1692f29818b1 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:15:26.491903 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-d1b6d807-f696-4669-a537-1692f29818b1 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062a94c1e6be4695b9758287aa82ab41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577bdb690df49f899cfa0f47ad5ba5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:15:26.499266 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-d1b6d807-f696-4669-a537-1692f29818b1 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] 10.222.0.30 "GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4" status: 200 len: 1574 microversion: 2.1 time: 0.149322 Aug 09 07:15:26.499853 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 468/939] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:15:26 2022] GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4 => generated 1574 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:15:27.521008 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-8b3971f8-3030-4613-9dd9-a372a782ae17 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:15:27.521923 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-8b3971f8-3030-4613-9dd9-a372a782ae17 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] [instance: 95ddb0e7-05cc-483c-8500-493ded6e2dd4] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:15:27.528593 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8b3971f8-3030-4613-9dd9-a372a782ae17 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:15:27.529067 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8b3971f8-3030-4613-9dd9-a372a782ae17 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:15:27.529495 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8b3971f8-3030-4613-9dd9-a372a782ae17 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:15:27.530185 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8b3971f8-3030-4613-9dd9-a372a782ae17 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:15:27.530633 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8b3971f8-3030-4613-9dd9-a372a782ae17 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:15:27.531053 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8b3971f8-3030-4613-9dd9-a372a782ae17 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:15:27.677398 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8b3971f8-3030-4613-9dd9-a372a782ae17 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062a94c1e6be4695b9758287aa82ab41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577bdb690df49f899cfa0f47ad5ba5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:15:27.684903 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-8b3971f8-3030-4613-9dd9-a372a782ae17 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] 10.222.0.30 "GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4" status: 200 len: 1574 microversion: 2.1 time: 0.168386 Aug 09 07:15:27.685458 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 472/940] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:15:27 2022] GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4 => generated 1574 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:15:28.705072 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-a3edd344-0455-46ec-859b-5aff348b35e5 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:15:28.705615 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-a3edd344-0455-46ec-859b-5aff348b35e5 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] [instance: 95ddb0e7-05cc-483c-8500-493ded6e2dd4] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:15:28.712507 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a3edd344-0455-46ec-859b-5aff348b35e5 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:15:28.712981 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a3edd344-0455-46ec-859b-5aff348b35e5 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:15:28.713409 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a3edd344-0455-46ec-859b-5aff348b35e5 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:15:28.714089 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a3edd344-0455-46ec-859b-5aff348b35e5 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:15:28.714533 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a3edd344-0455-46ec-859b-5aff348b35e5 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:15:28.714949 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a3edd344-0455-46ec-859b-5aff348b35e5 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:15:28.844055 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-a3edd344-0455-46ec-859b-5aff348b35e5 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062a94c1e6be4695b9758287aa82ab41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577bdb690df49f899cfa0f47ad5ba5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:15:28.852292 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-a3edd344-0455-46ec-859b-5aff348b35e5 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] 10.222.0.30 "GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4" status: 200 len: 1574 microversion: 2.1 time: 0.151141 Aug 09 07:15:28.852859 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 469/941] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:15:28 2022] GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4 => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:15:29.873892 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-de995738-2fb3-4863-901f-73ff85fcf808 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:15:29.874589 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-de995738-2fb3-4863-901f-73ff85fcf808 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] [instance: 95ddb0e7-05cc-483c-8500-493ded6e2dd4] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:15:29.881556 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-de995738-2fb3-4863-901f-73ff85fcf808 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:15:29.882039 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-de995738-2fb3-4863-901f-73ff85fcf808 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:15:29.882478 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-de995738-2fb3-4863-901f-73ff85fcf808 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:15:29.883170 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-de995738-2fb3-4863-901f-73ff85fcf808 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:15:29.883646 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-de995738-2fb3-4863-901f-73ff85fcf808 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:15:29.884074 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-de995738-2fb3-4863-901f-73ff85fcf808 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:15:30.016579 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-de995738-2fb3-4863-901f-73ff85fcf808 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062a94c1e6be4695b9758287aa82ab41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577bdb690df49f899cfa0f47ad5ba5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:15:30.024664 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-de995738-2fb3-4863-901f-73ff85fcf808 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] 10.222.0.30 "GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4" status: 200 len: 1574 microversion: 2.1 time: 0.154702 Aug 09 07:15:30.025231 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 473/942] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:15:29 2022] GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:15:31.044933 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-05e3af1f-dc50-4acb-b7fc-afcf9f5346d4 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:15:31.045539 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-05e3af1f-dc50-4acb-b7fc-afcf9f5346d4 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] [instance: 95ddb0e7-05cc-483c-8500-493ded6e2dd4] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:15:31.052035 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-05e3af1f-dc50-4acb-b7fc-afcf9f5346d4 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:15:31.052509 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-05e3af1f-dc50-4acb-b7fc-afcf9f5346d4 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:15:31.052943 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-05e3af1f-dc50-4acb-b7fc-afcf9f5346d4 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:15:31.053616 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-05e3af1f-dc50-4acb-b7fc-afcf9f5346d4 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:15:31.054061 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-05e3af1f-dc50-4acb-b7fc-afcf9f5346d4 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:15:31.054479 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-05e3af1f-dc50-4acb-b7fc-afcf9f5346d4 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:15:31.187525 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-05e3af1f-dc50-4acb-b7fc-afcf9f5346d4 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062a94c1e6be4695b9758287aa82ab41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577bdb690df49f899cfa0f47ad5ba5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:15:31.195985 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-05e3af1f-dc50-4acb-b7fc-afcf9f5346d4 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] 10.222.0.30 "GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4" status: 200 len: 1561 microversion: 2.1 time: 0.154936 Aug 09 07:15:31.196557 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 470/943] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:15:31 2022] GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:15:31.928898 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-be6a581f-ca08-481c-ab74-46447ed0d023 req-dbb76e90-2f3b-48ba-8f30-fcc911bd2018 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95ddb0e7-05cc-483c-8500-493ded6e2dd4", "name": "network-vif-plugged", "status": "completed", "tag": "f0efce78-5257-411a-8a3f-ddd3e3f7cd43"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:15:31.939618 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-be6a581f-ca08-481c-ab74-46447ed0d023 req-dbb76e90-2f3b-48ba-8f30-fcc911bd2018 service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:15:31.940083 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-be6a581f-ca08-481c-ab74-46447ed0d023 req-dbb76e90-2f3b-48ba-8f30-fcc911bd2018 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:15:31.940523 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-be6a581f-ca08-481c-ab74-46447ed0d023 req-dbb76e90-2f3b-48ba-8f30-fcc911bd2018 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:15:31.952686 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-be6a581f-ca08-481c-ab74-46447ed0d023 req-dbb76e90-2f3b-48ba-8f30-fcc911bd2018 service nova] Creating event network-vif-plugged:f0efce78-5257-411a-8a3f-ddd3e3f7cd43 for instance 95ddb0e7-05cc-483c-8500-493ded6e2dd4 on hv-cinder-85251 Aug 09 07:15:31.958237 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-be6a581f-ca08-481c-ab74-46447ed0d023 req-dbb76e90-2f3b-48ba-8f30-fcc911bd2018 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032435 Aug 09 07:15:31.958828 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 474/944] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:15:50.986176 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 07:15:50.986704 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Tue Aug 9 07:15:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 07:16:16.149535 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 07:16:16.150103 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Tue Aug 9 07:16:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 07:16:17.752464 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 07:16:17.753054 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Tue Aug 9 07:16:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 07:16:47.458946 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:16:47.460563 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:16:47.462946 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=26 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:16:47.463939 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:16:47.465181 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-eb3c48db-2c8d-4cb6-82cf-bcfd16bee7e0 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:16:47.465694 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-eb3c48db-2c8d-4cb6-82cf-bcfd16bee7e0 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] [instance: 95ddb0e7-05cc-483c-8500-493ded6e2dd4] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:16:47.473898 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-eb3c48db-2c8d-4cb6-82cf-bcfd16bee7e0 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:16:47.474779 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-eb3c48db-2c8d-4cb6-82cf-bcfd16bee7e0 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:16:47.475478 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-eb3c48db-2c8d-4cb6-82cf-bcfd16bee7e0 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:16:47.476568 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-eb3c48db-2c8d-4cb6-82cf-bcfd16bee7e0 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:16:47.477002 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-eb3c48db-2c8d-4cb6-82cf-bcfd16bee7e0 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:16:47.477694 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-eb3c48db-2c8d-4cb6-82cf-bcfd16bee7e0 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:16:47.509509 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-eb3c48db-2c8d-4cb6-82cf-bcfd16bee7e0 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] [instance: 95ddb0e7-05cc-483c-8500-493ded6e2dd4] Going to try to terminate instance {{(pid=117858) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 07:16:47.533464 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-b81694ec-fe9f-41bb-bb0a-8d74d3bad2aa req-e8ca542c-a8bb-4889-b45d-5571b7c9926d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95ddb0e7-05cc-483c-8500-493ded6e2dd4", "tag": "f0efce78-5257-411a-8a3f-ddd3e3f7cd43"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:16:47.544718 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-b81694ec-fe9f-41bb-bb0a-8d74d3bad2aa req-e8ca542c-a8bb-4889-b45d-5571b7c9926d service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:16:47.545274 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-b81694ec-fe9f-41bb-bb0a-8d74d3bad2aa req-e8ca542c-a8bb-4889-b45d-5571b7c9926d service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:16:47.545739 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-b81694ec-fe9f-41bb-bb0a-8d74d3bad2aa req-e8ca542c-a8bb-4889-b45d-5571b7c9926d service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:16:47.558300 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-b81694ec-fe9f-41bb-bb0a-8d74d3bad2aa req-e8ca542c-a8bb-4889-b45d-5571b7c9926d service nova] Creating event network-changed:f0efce78-5257-411a-8a3f-ddd3e3f7cd43 for instance 95ddb0e7-05cc-483c-8500-493ded6e2dd4 on hv-cinder-85251 Aug 09 07:16:47.563815 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-b81694ec-fe9f-41bb-bb0a-8d74d3bad2aa req-e8ca542c-a8bb-4889-b45d-5571b7c9926d service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103223 Aug 09 07:16:47.564746 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 475/945] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:16:47.599372 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-eb3c48db-2c8d-4cb6-82cf-bcfd16bee7e0 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] 10.222.0.30 "DELETE /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4" status: 204 len: 0 microversion: 2.1 time: 0.141881 Aug 09 07:16:47.607694 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 471/946] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 9 07:16:47 2022] DELETE /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 07:16:47.610353 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-8d851024-c73a-442f-8b97-2c8abf2a8d84 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:16:47.611061 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-8d851024-c73a-442f-8b97-2c8abf2a8d84 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] [instance: 95ddb0e7-05cc-483c-8500-493ded6e2dd4] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:16:47.617749 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8d851024-c73a-442f-8b97-2c8abf2a8d84 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:16:47.618240 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8d851024-c73a-442f-8b97-2c8abf2a8d84 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:16:47.618679 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8d851024-c73a-442f-8b97-2c8abf2a8d84 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:16:47.619414 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8d851024-c73a-442f-8b97-2c8abf2a8d84 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:16:47.620077 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8d851024-c73a-442f-8b97-2c8abf2a8d84 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:16:47.620692 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8d851024-c73a-442f-8b97-2c8abf2a8d84 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:16:47.758087 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8d851024-c73a-442f-8b97-2c8abf2a8d84 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062a94c1e6be4695b9758287aa82ab41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577bdb690df49f899cfa0f47ad5ba5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:16:47.765907 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-8d851024-c73a-442f-8b97-2c8abf2a8d84 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] 10.222.0.30 "GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4" status: 200 len: 1567 microversion: 2.1 time: 0.160049 Aug 09 07:16:47.766470 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 476/947] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:16:47 2022] GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:16:48.788463 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-50a0893e-b521-4605-83f2-df32f1f7fe7c tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:16:48.789175 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-50a0893e-b521-4605-83f2-df32f1f7fe7c tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] [instance: 95ddb0e7-05cc-483c-8500-493ded6e2dd4] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:16:48.796422 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-50a0893e-b521-4605-83f2-df32f1f7fe7c tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:16:48.796917 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-50a0893e-b521-4605-83f2-df32f1f7fe7c tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:16:48.797351 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-50a0893e-b521-4605-83f2-df32f1f7fe7c tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:16:48.798064 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-50a0893e-b521-4605-83f2-df32f1f7fe7c tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:16:48.798522 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-50a0893e-b521-4605-83f2-df32f1f7fe7c tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:16:48.798951 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-50a0893e-b521-4605-83f2-df32f1f7fe7c tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:16:48.940636 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-50a0893e-b521-4605-83f2-df32f1f7fe7c tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062a94c1e6be4695b9758287aa82ab41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577bdb690df49f899cfa0f47ad5ba5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:16:48.949064 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-50a0893e-b521-4605-83f2-df32f1f7fe7c tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] 10.222.0.30 "GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4" status: 200 len: 1567 microversion: 2.1 time: 0.165056 Aug 09 07:16:48.949569 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 472/948] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:16:48 2022] GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:16:49.930831 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-dfdb7ae3-f8eb-4d77-b0d0-43a4d8b6eb7d req-239dff72-1269-406b-b3f4-870b2abc205a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95ddb0e7-05cc-483c-8500-493ded6e2dd4", "name": "network-vif-deleted", "tag": "f0efce78-5257-411a-8a3f-ddd3e3f7cd43"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:16:49.941005 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-dfdb7ae3-f8eb-4d77-b0d0-43a4d8b6eb7d req-239dff72-1269-406b-b3f4-870b2abc205a service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:16:49.941477 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-dfdb7ae3-f8eb-4d77-b0d0-43a4d8b6eb7d req-239dff72-1269-406b-b3f4-870b2abc205a service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:16:49.941899 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-dfdb7ae3-f8eb-4d77-b0d0-43a4d8b6eb7d req-239dff72-1269-406b-b3f4-870b2abc205a service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:16:49.953378 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-dfdb7ae3-f8eb-4d77-b0d0-43a4d8b6eb7d req-239dff72-1269-406b-b3f4-870b2abc205a service nova] Creating event network-vif-deleted:f0efce78-5257-411a-8a3f-ddd3e3f7cd43 for instance 95ddb0e7-05cc-483c-8500-493ded6e2dd4 on hv-cinder-85251 Aug 09 07:16:49.957984 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-dfdb7ae3-f8eb-4d77-b0d0-43a4d8b6eb7d req-239dff72-1269-406b-b3f4-870b2abc205a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086634 Aug 09 07:16:49.958506 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 477/949] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:16:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:16:49.969988 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-bad40ffd-7691-46f2-9961-94a46cf6ada7 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:16:49.970590 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-bad40ffd-7691-46f2-9961-94a46cf6ada7 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] [instance: 95ddb0e7-05cc-483c-8500-493ded6e2dd4] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:16:49.976886 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-bad40ffd-7691-46f2-9961-94a46cf6ada7 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:16:49.977362 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-bad40ffd-7691-46f2-9961-94a46cf6ada7 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:16:49.977791 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-bad40ffd-7691-46f2-9961-94a46cf6ada7 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:16:49.978470 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-bad40ffd-7691-46f2-9961-94a46cf6ada7 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:16:49.978917 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-bad40ffd-7691-46f2-9961-94a46cf6ada7 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:16:49.979335 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-bad40ffd-7691-46f2-9961-94a46cf6ada7 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:16:50.040061 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-bad40ffd-7691-46f2-9961-94a46cf6ada7 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '062a94c1e6be4695b9758287aa82ab41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5577bdb690df49f899cfa0f47ad5ba5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:16:50.047469 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-bad40ffd-7691-46f2-9961-94a46cf6ada7 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] 10.222.0.30 "GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4" status: 200 len: 1217 microversion: 2.1 time: 0.081234 Aug 09 07:16:50.048050 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 473/950] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:16:49 2022] GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4 => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:16:51.069054 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-9337ca25-4c59-4e90-ac7e-f86724009298 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:16:51.069755 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-9337ca25-4c59-4e90-ac7e-f86724009298 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] [instance: 95ddb0e7-05cc-483c-8500-493ded6e2dd4] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:16:51.075904 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9337ca25-4c59-4e90-ac7e-f86724009298 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:16:51.076393 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9337ca25-4c59-4e90-ac7e-f86724009298 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:16:51.076826 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9337ca25-4c59-4e90-ac7e-f86724009298 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:16:51.077514 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9337ca25-4c59-4e90-ac7e-f86724009298 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:16:51.077972 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9337ca25-4c59-4e90-ac7e-f86724009298 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:16:51.078399 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9337ca25-4c59-4e90-ac7e-f86724009298 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:16:51.092474 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-9337ca25-4c59-4e90-ac7e-f86724009298 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] HTTP exception thrown: Instance 95ddb0e7-05cc-483c-8500-493ded6e2dd4 could not be found. Aug 09 07:16:51.094073 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-9337ca25-4c59-4e90-ac7e-f86724009298 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Request method failure captured: Aug 09 07:16:51.094073 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4 HTTP/1.1 Aug 09 07:16:51.094073 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 09 07:16:51.094073 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 09 07:16:51.094073 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Connection: close Aug 09 07:16:51.094073 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Length: 0 Aug 09 07:16:51.094073 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 09 07:16:51.094073 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.30 Aug 09 07:16:51.094073 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 09 07:16:51.094073 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.11 Aug 09 07:16:51.094073 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi8gjjCzBl0r4jc2j_4D2zj-kHOWHlc6osXjeKUbfPFrvYOuX_TnzZJelojBt29YLB-t4gJI42p8OHYdpQAfsoSJf7aXx32MX-i6635bC3KzA1ruqHH52C0MAAUgiNMFXzd0AHYmCJOkO7MIf5KYSSoPktSPKMVuerPCZY5bfs78sb0fk Aug 09 07:16:51.094073 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 09 07:16:51.094073 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 09 07:16:51.094073 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 09 07:16:51.094073 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 09 07:16:51.094073 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 09 07:16:51.094073 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 09 07:16:51.094073 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Id: 5577bdb690df49f899cfa0f47ad5ba5c Aug 09 07:16:51.094073 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-TestShelveInstance-1746197046 Aug 09 07:16:51.094073 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 09 07:16:51.094073 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 09 07:16:51.095798 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5577bdb690df49f899cfa0f47ad5ba5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_5577bdb690df49f899cfa0f47ad5ba5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/5577bdb690df49f899cfa0f47ad5ba5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/5577bdb690df49f899cfa0f47ad5ba5c"}]}] Aug 09 07:16:51.095798 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-TestShelveInstance-1746197046 Aug 09 07:16:51.095798 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: 5577bdb690df49f899cfa0f47ad5ba5c Aug 09 07:16:51.095798 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-TestShelveInstance-1746197046 Aug 09 07:16:51.095798 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User: tempest-TestShelveInstance-1746197046-project Aug 09 07:16:51.095798 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 09 07:16:51.095798 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 09 07:16:51.095798 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Id: 062a94c1e6be4695b9758287aa82ab41 Aug 09 07:16:51.095798 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-TestShelveInstance-1746197046-project Aug 09 07:16:51.095798 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: method: > Aug 09 07:16:51.095798 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: exception: Instance 95ddb0e7-05cc-483c-8500-493ded6e2dd4 could not be found. Aug 09 07:16:51.095798 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: action_args: {'id': '95ddb0e7-05cc-483c-8500-493ded6e2dd4'} Aug 09 07:16:51.096760 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 07:16:51.096760 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:16:51.096760 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 07:16:51.096760 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 07:16:51.096760 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 07:16:51.096760 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 07:16:51.096760 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 07:16:51.096760 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 07:16:51.096760 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 07:16:51.096760 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 07:16:51.096760 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95ddb0e7-05cc-483c-8500-493ded6e2dd4 could not be found. Aug 09 07:16:51.096760 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:16:51.096760 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:16:51.096760 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:16:51.096760 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:16:51.096760 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:16:51.096760 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:16:51.096760 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 07:16:51.096760 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 07:16:51.096760 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 07:16:51.098284 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 07:16:51.098284 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 07:16:51.098284 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 07:16:51.098284 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 07:16:51.098284 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 07:16:51.098284 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 07:16:51.098284 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 07:16:51.098284 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95ddb0e7-05cc-483c-8500-493ded6e2dd4 could not be found. Aug 09 07:16:51.098284 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:16:51.098284 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:16:51.098284 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:16:51.098284 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:16:51.098284 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:16:51.098284 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:16:51.098284 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 07:16:51.098284 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 07:16:51.098284 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95ddb0e7-05cc-483c-8500-493ded6e2dd4 could not be found. Aug 09 07:16:51.098284 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:16:51.100382 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-9337ca25-4c59-4e90-ac7e-f86724009298 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Returning 404 to user: Instance 95ddb0e7-05cc-483c-8500-493ded6e2dd4 could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 07:16:51.100382 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-9337ca25-4c59-4e90-ac7e-f86724009298 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] 10.222.0.30 "GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4" status: 404 len: 111 microversion: 2.1 time: 0.031260 Aug 09 07:16:51.100382 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 478/951] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:16:51 2022] GET /compute/v2.1/servers/95ddb0e7-05cc-483c-8500-493ded6e2dd4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 07:16:51.257447 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-92447af4-a876-44b9-a321-1dd8c49a98c1 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] Calling method '.version_select at 0x7f20ddb198b0>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:16:51.279467 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-92447af4-a876-44b9-a321-1dd8c49a98c1 tempest-TestShelveInstance-1746197046 tempest-TestShelveInstance-1746197046-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-692947109" status: 202 len: 0 microversion: 2.1 time: 0.026127 Aug 09 07:16:51.280189 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 474/952] 10.222.0.30 () {58 vars in 1251 bytes} [Tue Aug 9 07:16:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-692947109 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 07:17:07.784126 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=8 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:17:07.784734 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=12 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:17:07.986352 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-bb55a32c-d44d-4a3f-8894-a7bec44353f4 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Action: 'create', calling method: .version_select at 0x7f20dd4e6550>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-35902457", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHshJXkOnIFKbERYKtfpa5JOypDxww3aLlwQlnNCteVtbwOJ7Eo6qXS8yB4J3Q/I1aD4t1W/18csB9Qu3dLr5Q8GjMxJWgpAYVf2yjJ5iZKEMqRTvq9jZQFwM90w2ZvCOQ=="}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:17:08.004868 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-bb55a32c-d44d-4a3f-8894-a7bec44353f4 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Getting quotas for project ac9f07b87ad643b58d21be9042b64c87. Resources: {'key_pairs'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 07:17:08.009289 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-bb55a32c-d44d-4a3f-8894-a7bec44353f4 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Getting quotas for user cc228ac26c454318b15e1a2f198ebdf4 and project ac9f07b87ad643b58d21be9042b64c87. Resources: {'key_pairs'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 07:17:08.035958 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-bb55a32c-d44d-4a3f-8894-a7bec44353f4 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.258018 Aug 09 07:17:08.036619 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 479/953] 10.222.0.30 () {60 vars in 1159 bytes} [Tue Aug 9 07:17:07 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:17:23.412733 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:17:23.413543 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:17:23.417877 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-d4bba711-a014-43e4-a746-804db1d4b5f4 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-821359464", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-35902457", "security_groups": [{"name": "tempest-secgroup-smoke-1429632898"}], "block_device_mapping_v2": [{"uuid": "fb4241c5-f2f1-4e2f-9e0c-42f1c034df14", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4524a8ed-4b7c-43d5-97a8-67c6f1afc01e"}]}} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:17:23.529839 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.network.neutron [None req-d4bba711-a014-43e4-a746-804db1d4b5f4 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] validate_networks() for [('4524a8ed-4b7c-43d5-97a8-67c6f1afc01e', None, None, None, None, None)] {{(pid=117858) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 07:17:23.991708 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.virt.hardware [None req-d4bba711-a014-43e4-a746-804db1d4b5f4 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Flavor limits 0:0:0 {{(pid=117858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 07:17:23.992134 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.virt.hardware [None req-d4bba711-a014-43e4-a746-804db1d4b5f4 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Image limits 0:0:0 {{(pid=117858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 07:17:23.992609 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.virt.hardware [None req-d4bba711-a014-43e4-a746-804db1d4b5f4 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Flavor pref 0:0:0 {{(pid=117858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 07:17:23.993043 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.virt.hardware [None req-d4bba711-a014-43e4-a746-804db1d4b5f4 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Image pref 0:0:0 {{(pid=117858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 07:17:23.993452 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.virt.hardware [None req-d4bba711-a014-43e4-a746-804db1d4b5f4 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 07:17:24.001950 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d4bba711-a014-43e4-a746-804db1d4b5f4 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:17:24.002434 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d4bba711-a014-43e4-a746-804db1d4b5f4 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:17:24.002863 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d4bba711-a014-43e4-a746-804db1d4b5f4 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:17:24.003579 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d4bba711-a014-43e4-a746-804db1d4b5f4 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:17:24.004061 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d4bba711-a014-43e4-a746-804db1d4b5f4 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:17:24.004484 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d4bba711-a014-43e4-a746-804db1d4b5f4 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:17:24.021697 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.quota [None req-d4bba711-a014-43e4-a746-804db1d4b5f4 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Getting quotas for project ac9f07b87ad643b58d21be9042b64c87. Resources: {'cores', 'instances', 'ram'} {{(pid=117858) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 07:17:24.025563 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.quota [None req-d4bba711-a014-43e4-a746-804db1d4b5f4 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Getting quotas for user cc228ac26c454318b15e1a2f198ebdf4 and project ac9f07b87ad643b58d21be9042b64c87. Resources: {'cores', 'instances', 'ram'} {{(pid=117858) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 07:17:24.081163 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-d4bba711-a014-43e4-a746-804db1d4b5f4 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Going to run 1 instances... {{(pid=117858) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 07:17:24.083226 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-d4bba711-a014-43e4-a746-804db1d4b5f4 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: 1f2f5b4c-2968-48ca-8650-2479ce6055f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fb4241c5-f2f1-4e2f-9e0c-42f1c034df14',volume_size=None,volume_type=None)] {{(pid=117858) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 07:17:24.211090 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-d4bba711-a014-43e4-a746-804db1d4b5f4 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.800092 Aug 09 07:17:24.211745 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 475/954] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 9 07:17:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 07:17:24.219853 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=4 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:17:24.220594 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:17:24.224532 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-0360262d-3069-4731-8115-55b8325c4bd6 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:17:24.225183 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-0360262d-3069-4731-8115-55b8325c4bd6 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: 1f2f5b4c-2968-48ca-8650-2479ce6055f3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:17:24.280958 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-0360262d-3069-4731-8115-55b8325c4bd6 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc228ac26c454318b15e1a2f198ebdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f07b87ad643b58d21be9042b64c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:17:24.288748 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-0360262d-3069-4731-8115-55b8325c4bd6 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "GET /compute/v2.1/servers/1f2f5b4c-2968-48ca-8650-2479ce6055f3" status: 200 len: 1092 microversion: 2.1 time: 0.070140 Aug 09 07:17:24.289323 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 480/955] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:17:24 2022] GET /compute/v2.1/servers/1f2f5b4c-2968-48ca-8650-2479ce6055f3 => generated 1092 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:17:25.309903 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-1d854d86-78bf-45b3-8ceb-bc3c4d3cf865 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:17:25.311077 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-1d854d86-78bf-45b3-8ceb-bc3c4d3cf865 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: 1f2f5b4c-2968-48ca-8650-2479ce6055f3] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:17:25.317408 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1d854d86-78bf-45b3-8ceb-bc3c4d3cf865 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:17:25.317917 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1d854d86-78bf-45b3-8ceb-bc3c4d3cf865 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:17:25.318550 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1d854d86-78bf-45b3-8ceb-bc3c4d3cf865 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:17:25.319302 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1d854d86-78bf-45b3-8ceb-bc3c4d3cf865 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:17:25.320269 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1d854d86-78bf-45b3-8ceb-bc3c4d3cf865 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:17:25.320885 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1d854d86-78bf-45b3-8ceb-bc3c4d3cf865 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:17:25.397373 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-1d854d86-78bf-45b3-8ceb-bc3c4d3cf865 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc228ac26c454318b15e1a2f198ebdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f07b87ad643b58d21be9042b64c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:17:25.405056 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-1d854d86-78bf-45b3-8ceb-bc3c4d3cf865 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "GET /compute/v2.1/servers/1f2f5b4c-2968-48ca-8650-2479ce6055f3" status: 200 len: 1208 microversion: 2.1 time: 0.099401 Aug 09 07:17:25.405645 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 476/956] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:17:25 2022] GET /compute/v2.1/servers/1f2f5b4c-2968-48ca-8650-2479ce6055f3 => generated 1208 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:17:26.433944 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-84f9e2e6-877a-4c2d-83d3-1960d54965a3 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:17:26.434575 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-84f9e2e6-877a-4c2d-83d3-1960d54965a3 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: 1f2f5b4c-2968-48ca-8650-2479ce6055f3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:17:26.441172 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-84f9e2e6-877a-4c2d-83d3-1960d54965a3 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:17:26.441727 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-84f9e2e6-877a-4c2d-83d3-1960d54965a3 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:17:26.442293 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-84f9e2e6-877a-4c2d-83d3-1960d54965a3 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:17:26.443032 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-84f9e2e6-877a-4c2d-83d3-1960d54965a3 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:17:26.443493 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-84f9e2e6-877a-4c2d-83d3-1960d54965a3 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:17:26.443989 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-84f9e2e6-877a-4c2d-83d3-1960d54965a3 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:17:26.463777 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [req-d0f03b0b-2e53-44ed-a589-87692b22ff83 req-1d5f3dbb-5b75-4c0c-b2f5-102c05779371 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f2f5b4c-2968-48ca-8650-2479ce6055f3", "tag": "3cf7358c-cf83-46aa-adee-a76ccebee9d6"}]} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:17:26.476444 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-d0f03b0b-2e53-44ed-a589-87692b22ff83 req-1d5f3dbb-5b75-4c0c-b2f5-102c05779371 service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:17:26.477114 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-d0f03b0b-2e53-44ed-a589-87692b22ff83 req-1d5f3dbb-5b75-4c0c-b2f5-102c05779371 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:17:26.478120 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-d0f03b0b-2e53-44ed-a589-87692b22ff83 req-1d5f3dbb-5b75-4c0c-b2f5-102c05779371 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:17:26.489892 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.compute.server_external_events [req-d0f03b0b-2e53-44ed-a589-87692b22ff83 req-1d5f3dbb-5b75-4c0c-b2f5-102c05779371 service nova] Creating event network-changed:3cf7358c-cf83-46aa-adee-a76ccebee9d6 for instance 1f2f5b4c-2968-48ca-8650-2479ce6055f3 on hv-cinder-85251 Aug 09 07:17:26.495010 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [req-d0f03b0b-2e53-44ed-a589-87692b22ff83 req-1d5f3dbb-5b75-4c0c-b2f5-102c05779371 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036818 Aug 09 07:17:26.495842 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 477/957] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:17:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:17:26.607202 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-84f9e2e6-877a-4c2d-83d3-1960d54965a3 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc228ac26c454318b15e1a2f198ebdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f07b87ad643b58d21be9042b64c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:17:26.614899 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-84f9e2e6-877a-4c2d-83d3-1960d54965a3 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "GET /compute/v2.1/servers/1f2f5b4c-2968-48ca-8650-2479ce6055f3" status: 200 len: 1264 microversion: 2.1 time: 0.184735 Aug 09 07:17:26.615400 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 481/958] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:17:26 2022] GET /compute/v2.1/servers/1f2f5b4c-2968-48ca-8650-2479ce6055f3 => generated 1264 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:17:27.643650 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-9e0e786f-6f01-41cd-a3ec-bce3d229c315 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:17:27.644362 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-9e0e786f-6f01-41cd-a3ec-bce3d229c315 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: 1f2f5b4c-2968-48ca-8650-2479ce6055f3] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:17:27.651255 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9e0e786f-6f01-41cd-a3ec-bce3d229c315 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:17:27.651773 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9e0e786f-6f01-41cd-a3ec-bce3d229c315 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:17:27.652206 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9e0e786f-6f01-41cd-a3ec-bce3d229c315 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:17:27.652903 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9e0e786f-6f01-41cd-a3ec-bce3d229c315 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:17:27.653358 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9e0e786f-6f01-41cd-a3ec-bce3d229c315 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:17:27.653784 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-9e0e786f-6f01-41cd-a3ec-bce3d229c315 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:17:27.785923 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-9e0e786f-6f01-41cd-a3ec-bce3d229c315 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc228ac26c454318b15e1a2f198ebdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f07b87ad643b58d21be9042b64c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:17:27.793536 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-9e0e786f-6f01-41cd-a3ec-bce3d229c315 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "GET /compute/v2.1/servers/1f2f5b4c-2968-48ca-8650-2479ce6055f3" status: 200 len: 1264 microversion: 2.1 time: 0.160196 Aug 09 07:17:27.794097 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 478/959] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:17:27 2022] GET /compute/v2.1/servers/1f2f5b4c-2968-48ca-8650-2479ce6055f3 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:17:28.814269 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-8085fd76-4759-4ba3-9cfe-863c93383ac0 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:17:28.814914 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-8085fd76-4759-4ba3-9cfe-863c93383ac0 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: 1f2f5b4c-2968-48ca-8650-2479ce6055f3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:17:28.821497 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8085fd76-4759-4ba3-9cfe-863c93383ac0 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:17:28.821972 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8085fd76-4759-4ba3-9cfe-863c93383ac0 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:17:28.822404 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8085fd76-4759-4ba3-9cfe-863c93383ac0 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:17:28.823084 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8085fd76-4759-4ba3-9cfe-863c93383ac0 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:17:28.823535 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8085fd76-4759-4ba3-9cfe-863c93383ac0 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:17:28.823987 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8085fd76-4759-4ba3-9cfe-863c93383ac0 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:17:29.215173 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8085fd76-4759-4ba3-9cfe-863c93383ac0 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc228ac26c454318b15e1a2f198ebdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f07b87ad643b58d21be9042b64c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:17:29.222676 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-8085fd76-4759-4ba3-9cfe-863c93383ac0 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "GET /compute/v2.1/servers/1f2f5b4c-2968-48ca-8650-2479ce6055f3" status: 200 len: 1264 microversion: 2.1 time: 0.412297 Aug 09 07:17:29.223244 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 482/960] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:17:28 2022] GET /compute/v2.1/servers/1f2f5b4c-2968-48ca-8650-2479ce6055f3 => generated 1264 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:17:30.243558 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-1f02dc77-92cf-400b-8d80-b5cce90e6d93 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:17:30.244192 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-1f02dc77-92cf-400b-8d80-b5cce90e6d93 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: 1f2f5b4c-2968-48ca-8650-2479ce6055f3] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:17:30.250502 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1f02dc77-92cf-400b-8d80-b5cce90e6d93 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:17:30.250979 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1f02dc77-92cf-400b-8d80-b5cce90e6d93 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:17:30.251412 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1f02dc77-92cf-400b-8d80-b5cce90e6d93 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:17:30.252125 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1f02dc77-92cf-400b-8d80-b5cce90e6d93 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:17:30.253549 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1f02dc77-92cf-400b-8d80-b5cce90e6d93 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:17:30.253992 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-1f02dc77-92cf-400b-8d80-b5cce90e6d93 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:17:30.386099 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-1f02dc77-92cf-400b-8d80-b5cce90e6d93 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc228ac26c454318b15e1a2f198ebdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f07b87ad643b58d21be9042b64c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:17:30.393624 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-1f02dc77-92cf-400b-8d80-b5cce90e6d93 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "GET /compute/v2.1/servers/1f2f5b4c-2968-48ca-8650-2479ce6055f3" status: 200 len: 1264 microversion: 2.1 time: 0.154120 Aug 09 07:17:30.394177 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 479/961] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:17:30 2022] GET /compute/v2.1/servers/1f2f5b4c-2968-48ca-8650-2479ce6055f3 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:17:31.414823 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-da6933a9-72a8-4a9a-b493-ba61a2553e38 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:17:31.415429 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-da6933a9-72a8-4a9a-b493-ba61a2553e38 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: 1f2f5b4c-2968-48ca-8650-2479ce6055f3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:17:31.421855 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-da6933a9-72a8-4a9a-b493-ba61a2553e38 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:17:31.422329 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-da6933a9-72a8-4a9a-b493-ba61a2553e38 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:17:31.422754 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-da6933a9-72a8-4a9a-b493-ba61a2553e38 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:17:31.423435 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-da6933a9-72a8-4a9a-b493-ba61a2553e38 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:17:31.423909 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-da6933a9-72a8-4a9a-b493-ba61a2553e38 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:17:31.424325 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-da6933a9-72a8-4a9a-b493-ba61a2553e38 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:17:31.558505 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-da6933a9-72a8-4a9a-b493-ba61a2553e38 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc228ac26c454318b15e1a2f198ebdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f07b87ad643b58d21be9042b64c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:17:31.565794 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-da6933a9-72a8-4a9a-b493-ba61a2553e38 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "GET /compute/v2.1/servers/1f2f5b4c-2968-48ca-8650-2479ce6055f3" status: 200 len: 1264 microversion: 2.1 time: 0.155428 Aug 09 07:17:31.566353 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 483/962] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:17:31 2022] GET /compute/v2.1/servers/1f2f5b4c-2968-48ca-8650-2479ce6055f3 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:17:32.586146 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-0a1182c4-1e0f-4f4e-859e-a74ffb387129 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:17:32.586760 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-0a1182c4-1e0f-4f4e-859e-a74ffb387129 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: 1f2f5b4c-2968-48ca-8650-2479ce6055f3] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:17:32.593117 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0a1182c4-1e0f-4f4e-859e-a74ffb387129 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:17:32.593598 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0a1182c4-1e0f-4f4e-859e-a74ffb387129 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:17:32.594034 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0a1182c4-1e0f-4f4e-859e-a74ffb387129 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:17:32.594725 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0a1182c4-1e0f-4f4e-859e-a74ffb387129 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:17:32.595179 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0a1182c4-1e0f-4f4e-859e-a74ffb387129 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:17:32.595618 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0a1182c4-1e0f-4f4e-859e-a74ffb387129 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:17:32.726594 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-0a1182c4-1e0f-4f4e-859e-a74ffb387129 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc228ac26c454318b15e1a2f198ebdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f07b87ad643b58d21be9042b64c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:17:32.733994 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-0a1182c4-1e0f-4f4e-859e-a74ffb387129 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "GET /compute/v2.1/servers/1f2f5b4c-2968-48ca-8650-2479ce6055f3" status: 200 len: 1264 microversion: 2.1 time: 0.151840 Aug 09 07:17:32.734560 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 480/963] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:17:32 2022] GET /compute/v2.1/servers/1f2f5b4c-2968-48ca-8650-2479ce6055f3 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:17:33.754104 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-378737e9-7344-45b3-b0ab-b555ef225db3 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:17:33.754724 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-378737e9-7344-45b3-b0ab-b555ef225db3 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: 1f2f5b4c-2968-48ca-8650-2479ce6055f3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:17:33.761859 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-378737e9-7344-45b3-b0ab-b555ef225db3 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:17:33.762345 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-378737e9-7344-45b3-b0ab-b555ef225db3 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:17:33.762784 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-378737e9-7344-45b3-b0ab-b555ef225db3 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:17:33.763477 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-378737e9-7344-45b3-b0ab-b555ef225db3 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:17:33.763964 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-378737e9-7344-45b3-b0ab-b555ef225db3 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:17:33.764393 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-378737e9-7344-45b3-b0ab-b555ef225db3 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:17:33.896351 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-378737e9-7344-45b3-b0ab-b555ef225db3 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc228ac26c454318b15e1a2f198ebdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f07b87ad643b58d21be9042b64c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:17:33.903834 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-378737e9-7344-45b3-b0ab-b555ef225db3 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "GET /compute/v2.1/servers/1f2f5b4c-2968-48ca-8650-2479ce6055f3" status: 200 len: 1264 microversion: 2.1 time: 0.153604 Aug 09 07:17:33.904403 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 484/964] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:17:33 2022] GET /compute/v2.1/servers/1f2f5b4c-2968-48ca-8650-2479ce6055f3 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:17:34.923933 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-3496f172-c489-4bd1-a987-4f39393ce138 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:17:34.924540 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-3496f172-c489-4bd1-a987-4f39393ce138 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: 1f2f5b4c-2968-48ca-8650-2479ce6055f3] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:17:34.926873 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_cell0:SELECT=2 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:17:34.927665 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_cell0:SELECT=6 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:17:34.933123 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3496f172-c489-4bd1-a987-4f39393ce138 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:17:34.933598 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3496f172-c489-4bd1-a987-4f39393ce138 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:17:34.934025 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3496f172-c489-4bd1-a987-4f39393ce138 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:17:34.934697 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3496f172-c489-4bd1-a987-4f39393ce138 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:17:34.935142 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3496f172-c489-4bd1-a987-4f39393ce138 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:17:34.935586 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-3496f172-c489-4bd1-a987-4f39393ce138 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:17:35.063470 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-3496f172-c489-4bd1-a987-4f39393ce138 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc228ac26c454318b15e1a2f198ebdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f07b87ad643b58d21be9042b64c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:17:35.071315 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-3496f172-c489-4bd1-a987-4f39393ce138 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "GET /compute/v2.1/servers/1f2f5b4c-2968-48ca-8650-2479ce6055f3" status: 200 len: 1264 microversion: 2.1 time: 0.151174 Aug 09 07:17:35.071899 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 481/965] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:17:34 2022] GET /compute/v2.1/servers/1f2f5b4c-2968-48ca-8650-2479ce6055f3 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:17:36.091204 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-0b877d3e-e58b-4b5b-80db-02b9e6a1ddbe tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:17:36.091876 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-0b877d3e-e58b-4b5b-80db-02b9e6a1ddbe tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: 1f2f5b4c-2968-48ca-8650-2479ce6055f3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:17:36.093759 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=2 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:17:36.100829 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0b877d3e-e58b-4b5b-80db-02b9e6a1ddbe tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:17:36.101321 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0b877d3e-e58b-4b5b-80db-02b9e6a1ddbe tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:17:36.101788 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0b877d3e-e58b-4b5b-80db-02b9e6a1ddbe tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:17:36.102495 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0b877d3e-e58b-4b5b-80db-02b9e6a1ddbe tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:17:36.102951 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0b877d3e-e58b-4b5b-80db-02b9e6a1ddbe tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:17:36.103410 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0b877d3e-e58b-4b5b-80db-02b9e6a1ddbe tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:17:36.231893 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-0b877d3e-e58b-4b5b-80db-02b9e6a1ddbe tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc228ac26c454318b15e1a2f198ebdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f07b87ad643b58d21be9042b64c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:17:36.239314 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-0b877d3e-e58b-4b5b-80db-02b9e6a1ddbe tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "GET /compute/v2.1/servers/1f2f5b4c-2968-48ca-8650-2479ce6055f3" status: 200 len: 1264 microversion: 2.1 time: 0.152029 Aug 09 07:17:36.239943 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 485/966] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:17:36 2022] GET /compute/v2.1/servers/1f2f5b4c-2968-48ca-8650-2479ce6055f3 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:17:37.260193 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-ae9290f0-b23c-4aaf-b603-13319d633afc tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:17:37.260812 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-ae9290f0-b23c-4aaf-b603-13319d633afc tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: 1f2f5b4c-2968-48ca-8650-2479ce6055f3] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:17:37.267162 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ae9290f0-b23c-4aaf-b603-13319d633afc tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:17:37.267685 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ae9290f0-b23c-4aaf-b603-13319d633afc tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:17:37.268129 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ae9290f0-b23c-4aaf-b603-13319d633afc tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:17:37.268824 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ae9290f0-b23c-4aaf-b603-13319d633afc tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:17:37.269282 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ae9290f0-b23c-4aaf-b603-13319d633afc tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:17:37.269710 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-ae9290f0-b23c-4aaf-b603-13319d633afc tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:17:37.401923 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-ae9290f0-b23c-4aaf-b603-13319d633afc tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc228ac26c454318b15e1a2f198ebdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f07b87ad643b58d21be9042b64c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:17:37.409258 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-ae9290f0-b23c-4aaf-b603-13319d633afc tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "GET /compute/v2.1/servers/1f2f5b4c-2968-48ca-8650-2479ce6055f3" status: 200 len: 1264 microversion: 2.1 time: 0.153330 Aug 09 07:17:37.409815 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 482/967] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:17:37 2022] GET /compute/v2.1/servers/1f2f5b4c-2968-48ca-8650-2479ce6055f3 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:17:38.430938 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-14f7c599-95dc-43e4-859c-7d6870f9e9a8 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:17:38.431551 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-14f7c599-95dc-43e4-859c-7d6870f9e9a8 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: 1f2f5b4c-2968-48ca-8650-2479ce6055f3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:17:38.437831 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-14f7c599-95dc-43e4-859c-7d6870f9e9a8 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:17:38.438309 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-14f7c599-95dc-43e4-859c-7d6870f9e9a8 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:17:38.438736 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-14f7c599-95dc-43e4-859c-7d6870f9e9a8 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:17:38.439419 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-14f7c599-95dc-43e4-859c-7d6870f9e9a8 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:17:38.439891 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-14f7c599-95dc-43e4-859c-7d6870f9e9a8 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:17:38.440308 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-14f7c599-95dc-43e4-859c-7d6870f9e9a8 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:17:38.508607 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [req-a552df9f-90d6-4dbc-a9c2-47a9d406e4f5 req-8088f5df-541e-48a1-82d2-166eb86fdfbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f2f5b4c-2968-48ca-8650-2479ce6055f3", "name": "network-vif-plugged", "status": "completed", "tag": "3cf7358c-cf83-46aa-adee-a76ccebee9d6"}]} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:17:38.519834 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-a552df9f-90d6-4dbc-a9c2-47a9d406e4f5 req-8088f5df-541e-48a1-82d2-166eb86fdfbb service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:17:38.520698 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-a552df9f-90d6-4dbc-a9c2-47a9d406e4f5 req-8088f5df-541e-48a1-82d2-166eb86fdfbb service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:17:38.521301 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-a552df9f-90d6-4dbc-a9c2-47a9d406e4f5 req-8088f5df-541e-48a1-82d2-166eb86fdfbb service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:17:38.533551 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.compute.server_external_events [req-a552df9f-90d6-4dbc-a9c2-47a9d406e4f5 req-8088f5df-541e-48a1-82d2-166eb86fdfbb service nova] Creating event network-vif-plugged:3cf7358c-cf83-46aa-adee-a76ccebee9d6 for instance 1f2f5b4c-2968-48ca-8650-2479ce6055f3 on hv-cinder-85251 Aug 09 07:17:38.539394 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [req-a552df9f-90d6-4dbc-a9c2-47a9d406e4f5 req-8088f5df-541e-48a1-82d2-166eb86fdfbb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035122 Aug 09 07:17:38.540941 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 483/968] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:17:38.578031 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-14f7c599-95dc-43e4-859c-7d6870f9e9a8 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc228ac26c454318b15e1a2f198ebdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f07b87ad643b58d21be9042b64c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:17:38.591255 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-14f7c599-95dc-43e4-859c-7d6870f9e9a8 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "GET /compute/v2.1/servers/1f2f5b4c-2968-48ca-8650-2479ce6055f3" status: 200 len: 1264 microversion: 2.1 time: 0.164749 Aug 09 07:17:38.591866 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 486/969] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:17:38 2022] GET /compute/v2.1/servers/1f2f5b4c-2968-48ca-8650-2479ce6055f3 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:17:39.613090 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-66530cef-5e35-4aca-9820-f027a247eb01 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:17:39.613898 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-66530cef-5e35-4aca-9820-f027a247eb01 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: 1f2f5b4c-2968-48ca-8650-2479ce6055f3] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:17:39.620560 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-66530cef-5e35-4aca-9820-f027a247eb01 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:17:39.621034 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-66530cef-5e35-4aca-9820-f027a247eb01 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:17:39.621489 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-66530cef-5e35-4aca-9820-f027a247eb01 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:17:39.622168 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-66530cef-5e35-4aca-9820-f027a247eb01 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:17:39.622610 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-66530cef-5e35-4aca-9820-f027a247eb01 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:17:39.623027 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-66530cef-5e35-4aca-9820-f027a247eb01 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:17:39.762715 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-66530cef-5e35-4aca-9820-f027a247eb01 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc228ac26c454318b15e1a2f198ebdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f07b87ad643b58d21be9042b64c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:17:39.770387 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-66530cef-5e35-4aca-9820-f027a247eb01 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "GET /compute/v2.1/servers/1f2f5b4c-2968-48ca-8650-2479ce6055f3" status: 200 len: 1264 microversion: 2.1 time: 0.162009 Aug 09 07:17:39.770976 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 484/970] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:17:39 2022] GET /compute/v2.1/servers/1f2f5b4c-2968-48ca-8650-2479ce6055f3 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:17:40.791148 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-95295f62-08be-4502-a08d-776ba00213eb tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:17:40.791721 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-95295f62-08be-4502-a08d-776ba00213eb tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: 1f2f5b4c-2968-48ca-8650-2479ce6055f3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:17:40.798055 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-95295f62-08be-4502-a08d-776ba00213eb tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:17:40.798534 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-95295f62-08be-4502-a08d-776ba00213eb tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:17:40.798969 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-95295f62-08be-4502-a08d-776ba00213eb tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:17:40.799692 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-95295f62-08be-4502-a08d-776ba00213eb tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:17:40.800153 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-95295f62-08be-4502-a08d-776ba00213eb tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:17:40.800580 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-95295f62-08be-4502-a08d-776ba00213eb tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:17:40.929956 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-95295f62-08be-4502-a08d-776ba00213eb tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc228ac26c454318b15e1a2f198ebdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f07b87ad643b58d21be9042b64c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:17:40.937328 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-95295f62-08be-4502-a08d-776ba00213eb tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "GET /compute/v2.1/servers/1f2f5b4c-2968-48ca-8650-2479ce6055f3" status: 200 len: 1452 microversion: 2.1 time: 0.150964 Aug 09 07:17:40.937891 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 487/971] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:17:40 2022] GET /compute/v2.1/servers/1f2f5b4c-2968-48ca-8650-2479ce6055f3 => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:17:40.957501 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-788d69cf-e81c-4576-8cec-990952159c1a tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:17:40.958104 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-788d69cf-e81c-4576-8cec-990952159c1a tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: 1f2f5b4c-2968-48ca-8650-2479ce6055f3] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:17:40.964619 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-788d69cf-e81c-4576-8cec-990952159c1a tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:17:40.965093 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-788d69cf-e81c-4576-8cec-990952159c1a tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:17:40.965519 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-788d69cf-e81c-4576-8cec-990952159c1a tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:17:40.966196 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-788d69cf-e81c-4576-8cec-990952159c1a tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:17:40.966641 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-788d69cf-e81c-4576-8cec-990952159c1a tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:17:40.967059 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-788d69cf-e81c-4576-8cec-990952159c1a tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:17:41.093601 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-788d69cf-e81c-4576-8cec-990952159c1a tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc228ac26c454318b15e1a2f198ebdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f07b87ad643b58d21be9042b64c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:17:41.101554 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-788d69cf-e81c-4576-8cec-990952159c1a tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "GET /compute/v2.1/servers/1f2f5b4c-2968-48ca-8650-2479ce6055f3" status: 200 len: 1452 microversion: 2.1 time: 0.147799 Aug 09 07:17:41.102106 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 485/972] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:17:40 2022] GET /compute/v2.1/servers/1f2f5b4c-2968-48ca-8650-2479ce6055f3 => generated 1452 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:17:42.706975 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-eded53a6-996a-4a76-ba92-98cfe24a9e0b req-a7e2c7f4-bc89-44ff-92f2-349bc25c7fb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f2f5b4c-2968-48ca-8650-2479ce6055f3", "tag": "3cf7358c-cf83-46aa-adee-a76ccebee9d6"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:17:42.718160 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-eded53a6-996a-4a76-ba92-98cfe24a9e0b req-a7e2c7f4-bc89-44ff-92f2-349bc25c7fb2 service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:17:42.718721 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-eded53a6-996a-4a76-ba92-98cfe24a9e0b req-a7e2c7f4-bc89-44ff-92f2-349bc25c7fb2 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:17:42.719190 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-eded53a6-996a-4a76-ba92-98cfe24a9e0b req-a7e2c7f4-bc89-44ff-92f2-349bc25c7fb2 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:17:42.730263 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-eded53a6-996a-4a76-ba92-98cfe24a9e0b req-a7e2c7f4-bc89-44ff-92f2-349bc25c7fb2 service nova] Creating event network-changed:3cf7358c-cf83-46aa-adee-a76ccebee9d6 for instance 1f2f5b4c-2968-48ca-8650-2479ce6055f3 on hv-cinder-85251 Aug 09 07:17:42.735501 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-eded53a6-996a-4a76-ba92-98cfe24a9e0b req-a7e2c7f4-bc89-44ff-92f2-349bc25c7fb2 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032321 Aug 09 07:17:42.736128 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 488/973] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:17:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:19:20.474988 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 07:19:20.475624 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Tue Aug 9 07:19:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 07:19:36.157728 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 07:19:36.158384 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Tue Aug 9 07:19:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 07:19:37.771458 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a0e2e062-ee61-45e6-aa42-20cb3f8e13fa] AMQP server on 10.222.0.30:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 09 07:19:37.772059 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:19:37.772756 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_cell1:SELECT=54 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:19:37.776670 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-d0f3ee00-e461-4013-bfe3-afbcaa829527 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:19:37.777156 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-d0f3ee00-e461-4013-bfe3-afbcaa829527 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: 1f2f5b4c-2968-48ca-8650-2479ce6055f3] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:19:37.784650 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d0f3ee00-e461-4013-bfe3-afbcaa829527 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:19:37.785136 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d0f3ee00-e461-4013-bfe3-afbcaa829527 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:19:37.785570 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d0f3ee00-e461-4013-bfe3-afbcaa829527 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:19:37.786247 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d0f3ee00-e461-4013-bfe3-afbcaa829527 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:19:37.786692 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d0f3ee00-e461-4013-bfe3-afbcaa829527 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:19:37.787108 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-d0f3ee00-e461-4013-bfe3-afbcaa829527 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:19:37.813473 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-d0f3ee00-e461-4013-bfe3-afbcaa829527 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: 1f2f5b4c-2968-48ca-8650-2479ce6055f3] Going to try to terminate instance {{(pid=117858) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 07:19:37.888868 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-d0f3ee00-e461-4013-bfe3-afbcaa829527 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1f2f5b4c-2968-48ca-8650-2479ce6055f3" status: 204 len: 0 microversion: 2.1 time: 0.119306 Aug 09 07:19:37.889448 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 486/974] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 9 07:19:37 2022] DELETE /compute/v2.1/servers/1f2f5b4c-2968-48ca-8650-2479ce6055f3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 07:19:37.895952 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR oslo.messaging._drivers.impl_rabbit [-] [34a7199e-a4df-42a4-9384-ee882bc0db41] AMQP server on 10.222.0.30:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 09 07:19:37.896577 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=20 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:19:37.897308 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=44 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:19:37.901920 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a9bcf75d-472e-4539-9993-c46b558a426e tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:19:37.902613 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-a9bcf75d-472e-4539-9993-c46b558a426e tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: 1f2f5b4c-2968-48ca-8650-2479ce6055f3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:19:37.909560 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a9bcf75d-472e-4539-9993-c46b558a426e tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:19:37.910030 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a9bcf75d-472e-4539-9993-c46b558a426e tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:19:37.910456 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a9bcf75d-472e-4539-9993-c46b558a426e tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:19:37.911137 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a9bcf75d-472e-4539-9993-c46b558a426e tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:19:37.911582 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a9bcf75d-472e-4539-9993-c46b558a426e tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:19:37.912019 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a9bcf75d-472e-4539-9993-c46b558a426e tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:19:38.099265 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-a9bcf75d-472e-4539-9993-c46b558a426e tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc228ac26c454318b15e1a2f198ebdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f07b87ad643b58d21be9042b64c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:19:38.106902 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-a9bcf75d-472e-4539-9993-c46b558a426e tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "GET /compute/v2.1/servers/1f2f5b4c-2968-48ca-8650-2479ce6055f3" status: 200 len: 1577 microversion: 2.1 time: 0.212819 Aug 09 07:19:38.107463 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 489/975] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:19:37 2022] GET /compute/v2.1/servers/1f2f5b4c-2968-48ca-8650-2479ce6055f3 => generated 1577 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:19:39.129756 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-60c3ffff-d564-4761-a872-e56a0b673917 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:19:39.130374 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-60c3ffff-d564-4761-a872-e56a0b673917 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: 1f2f5b4c-2968-48ca-8650-2479ce6055f3] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:19:39.138227 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-60c3ffff-d564-4761-a872-e56a0b673917 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:19:39.138711 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-60c3ffff-d564-4761-a872-e56a0b673917 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:19:39.139145 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-60c3ffff-d564-4761-a872-e56a0b673917 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:19:39.140605 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-60c3ffff-d564-4761-a872-e56a0b673917 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:19:39.141061 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-60c3ffff-d564-4761-a872-e56a0b673917 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:19:39.141488 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-60c3ffff-d564-4761-a872-e56a0b673917 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:19:39.146730 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO oslo.messaging._drivers.impl_rabbit [-] [a0e2e062-ee61-45e6-aa42-20cb3f8e13fa] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 43484. Aug 09 07:19:39.324296 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-60c3ffff-d564-4761-a872-e56a0b673917 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc228ac26c454318b15e1a2f198ebdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f07b87ad643b58d21be9042b64c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:19:39.332327 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-60c3ffff-d564-4761-a872-e56a0b673917 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "GET /compute/v2.1/servers/1f2f5b4c-2968-48ca-8650-2479ce6055f3" status: 200 len: 1577 microversion: 2.1 time: 0.206884 Aug 09 07:19:39.332887 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 487/976] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:19:39 2022] GET /compute/v2.1/servers/1f2f5b4c-2968-48ca-8650-2479ce6055f3 => generated 1577 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:19:40.221657 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-003f7b25-6cc9-423b-b3ee-ee791c2ff0dd req-918172c2-8cdb-4651-b78e-d59284634428 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f2f5b4c-2968-48ca-8650-2479ce6055f3", "name": "network-vif-deleted", "tag": "3cf7358c-cf83-46aa-adee-a76ccebee9d6"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:19:40.238066 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO oslo.messaging._drivers.impl_rabbit [-] [34a7199e-a4df-42a4-9384-ee882bc0db41] Reconnected to AMQP server on 10.222.0.30:5672 via [amqp] client with port 43490. Aug 09 07:19:40.242861 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-003f7b25-6cc9-423b-b3ee-ee791c2ff0dd req-918172c2-8cdb-4651-b78e-d59284634428 service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:19:40.243343 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-003f7b25-6cc9-423b-b3ee-ee791c2ff0dd req-918172c2-8cdb-4651-b78e-d59284634428 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:19:40.243807 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-003f7b25-6cc9-423b-b3ee-ee791c2ff0dd req-918172c2-8cdb-4651-b78e-d59284634428 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:19:40.258312 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-003f7b25-6cc9-423b-b3ee-ee791c2ff0dd req-918172c2-8cdb-4651-b78e-d59284634428 service nova] Creating event network-vif-deleted:3cf7358c-cf83-46aa-adee-a76ccebee9d6 for instance 1f2f5b4c-2968-48ca-8650-2479ce6055f3 on hv-cinder-85251 Aug 09 07:19:40.263783 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-003f7b25-6cc9-423b-b3ee-ee791c2ff0dd req-918172c2-8cdb-4651-b78e-d59284634428 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046500 Aug 09 07:19:40.264624 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 490/977] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:19:40.353916 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-018171d2-9a49-4493-b2f4-1ce902a9211f tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:19:40.354666 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-018171d2-9a49-4493-b2f4-1ce902a9211f tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: 1f2f5b4c-2968-48ca-8650-2479ce6055f3] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:19:40.361812 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-018171d2-9a49-4493-b2f4-1ce902a9211f tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:19:40.362430 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-018171d2-9a49-4493-b2f4-1ce902a9211f tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:19:40.362966 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-018171d2-9a49-4493-b2f4-1ce902a9211f tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:19:40.363798 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-018171d2-9a49-4493-b2f4-1ce902a9211f tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:19:40.364461 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-018171d2-9a49-4493-b2f4-1ce902a9211f tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:19:40.365110 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-018171d2-9a49-4493-b2f4-1ce902a9211f tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:19:40.434221 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-018171d2-9a49-4493-b2f4-1ce902a9211f tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc228ac26c454318b15e1a2f198ebdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f07b87ad643b58d21be9042b64c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:19:40.444804 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-018171d2-9a49-4493-b2f4-1ce902a9211f tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "GET /compute/v2.1/servers/1f2f5b4c-2968-48ca-8650-2479ce6055f3" status: 200 len: 1223 microversion: 2.1 time: 0.094623 Aug 09 07:19:40.445894 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 488/978] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:19:40 2022] GET /compute/v2.1/servers/1f2f5b4c-2968-48ca-8650-2479ce6055f3 => generated 1223 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:19:41.466467 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-3072afe4-5f7b-4c0f-a030-1bf8ff20af3f tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:19:41.467083 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-3072afe4-5f7b-4c0f-a030-1bf8ff20af3f tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: 1f2f5b4c-2968-48ca-8650-2479ce6055f3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:19:41.474409 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3072afe4-5f7b-4c0f-a030-1bf8ff20af3f tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:19:41.474901 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3072afe4-5f7b-4c0f-a030-1bf8ff20af3f tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:19:41.475340 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3072afe4-5f7b-4c0f-a030-1bf8ff20af3f tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:19:41.476065 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3072afe4-5f7b-4c0f-a030-1bf8ff20af3f tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:19:41.476524 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3072afe4-5f7b-4c0f-a030-1bf8ff20af3f tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:19:41.476951 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3072afe4-5f7b-4c0f-a030-1bf8ff20af3f tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:19:41.490024 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-3072afe4-5f7b-4c0f-a030-1bf8ff20af3f tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] HTTP exception thrown: Instance 1f2f5b4c-2968-48ca-8650-2479ce6055f3 could not be found. Aug 09 07:19:41.491637 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-3072afe4-5f7b-4c0f-a030-1bf8ff20af3f tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Request method failure captured: Aug 09 07:19:41.491637 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/1f2f5b4c-2968-48ca-8650-2479ce6055f3 HTTP/1.1 Aug 09 07:19:41.491637 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 09 07:19:41.491637 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 09 07:19:41.491637 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Connection: close Aug 09 07:19:41.491637 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Length: 0 Aug 09 07:19:41.491637 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 09 07:19:41.491637 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.30 Aug 09 07:19:41.491637 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 09 07:19:41.491637 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.11 Aug 09 07:19:41.491637 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi8gnvg8JDG_B6ue6tyPjxvTN8FthbXragKGXJf2rs8bibfgy1wxkjza7BgRBbgHtx2fAUNW0nDhnjHvWNZHg6ZGsTOpybjf8GXol81veOwYQaBQ1aAnO8xDOIcICyhKDsUlX6EaLDzIaop7Y5uZ6f7fhR7PWBYBdYUEhGONPLK80UcI8 Aug 09 07:19:41.491637 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 09 07:19:41.491637 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 09 07:19:41.491637 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 09 07:19:41.491637 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 09 07:19:41.491637 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 09 07:19:41.491637 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 09 07:19:41.491637 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Id: ac9f07b87ad643b58d21be9042b64c87 Aug 09 07:19:41.491637 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-TestVolumeBootPattern-2044081928 Aug 09 07:19:41.491637 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 09 07:19:41.491637 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 09 07:19:41.493401 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ac9f07b87ad643b58d21be9042b64c87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ac9f07b87ad643b58d21be9042b64c87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ac9f07b87ad643b58d21be9042b64c87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ac9f07b87ad643b58d21be9042b64c87"}]}] Aug 09 07:19:41.493401 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-TestVolumeBootPattern-2044081928 Aug 09 07:19:41.493401 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: ac9f07b87ad643b58d21be9042b64c87 Aug 09 07:19:41.493401 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-TestVolumeBootPattern-2044081928 Aug 09 07:19:41.493401 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User: tempest-TestVolumeBootPattern-2044081928-project Aug 09 07:19:41.493401 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 09 07:19:41.493401 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 09 07:19:41.493401 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Id: cc228ac26c454318b15e1a2f198ebdf4 Aug 09 07:19:41.493401 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-TestVolumeBootPattern-2044081928-project Aug 09 07:19:41.493401 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: method: > Aug 09 07:19:41.493401 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: exception: Instance 1f2f5b4c-2968-48ca-8650-2479ce6055f3 could not be found. Aug 09 07:19:41.493401 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: action_args: {'id': '1f2f5b4c-2968-48ca-8650-2479ce6055f3'} Aug 09 07:19:41.494549 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 07:19:41.494549 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:19:41.494549 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 07:19:41.494549 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 07:19:41.494549 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 07:19:41.494549 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 07:19:41.494549 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 07:19:41.494549 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 07:19:41.494549 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 07:19:41.494549 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 07:19:41.494549 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f2f5b4c-2968-48ca-8650-2479ce6055f3 could not be found. Aug 09 07:19:41.494549 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:19:41.494549 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:19:41.494549 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:19:41.494549 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:19:41.494549 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:19:41.494549 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:19:41.494549 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 07:19:41.494549 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 07:19:41.494549 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 07:19:41.496224 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 07:19:41.496224 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 07:19:41.496224 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 07:19:41.496224 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 07:19:41.496224 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 07:19:41.496224 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 07:19:41.496224 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 07:19:41.496224 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f2f5b4c-2968-48ca-8650-2479ce6055f3 could not be found. Aug 09 07:19:41.496224 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:19:41.496224 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:19:41.496224 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:19:41.496224 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:19:41.496224 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:19:41.496224 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:19:41.496224 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 07:19:41.496224 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 07:19:41.496224 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f2f5b4c-2968-48ca-8650-2479ce6055f3 could not be found. Aug 09 07:19:41.496224 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:19:41.497680 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-3072afe4-5f7b-4c0f-a030-1bf8ff20af3f tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Returning 404 to user: Instance 1f2f5b4c-2968-48ca-8650-2479ce6055f3 could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 07:19:41.497680 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-3072afe4-5f7b-4c0f-a030-1bf8ff20af3f tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "GET /compute/v2.1/servers/1f2f5b4c-2968-48ca-8650-2479ce6055f3" status: 404 len: 111 microversion: 2.1 time: 0.030941 Aug 09 07:19:41.497680 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 491/979] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:19:41 2022] GET /compute/v2.1/servers/1f2f5b4c-2968-48ca-8650-2479ce6055f3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 07:19:41.540120 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-57c46ff1-ea9b-4298-af0a-10a4f0d89c9d tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1112540646", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-35902457", "security_groups": [{"name": "tempest-secgroup-smoke-1429632898"}], "block_device_mapping_v2": [{"uuid": "fb4241c5-f2f1-4e2f-9e0c-42f1c034df14", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4524a8ed-4b7c-43d5-97a8-67c6f1afc01e"}]}} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:19:41.656679 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.network.neutron [None req-57c46ff1-ea9b-4298-af0a-10a4f0d89c9d tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] validate_networks() for [('4524a8ed-4b7c-43d5-97a8-67c6f1afc01e', None, None, None, None, None)] {{(pid=117858) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 07:19:42.018450 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.virt.hardware [None req-57c46ff1-ea9b-4298-af0a-10a4f0d89c9d tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Flavor limits 0:0:0 {{(pid=117858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 07:19:42.018870 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.virt.hardware [None req-57c46ff1-ea9b-4298-af0a-10a4f0d89c9d tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Image limits 0:0:0 {{(pid=117858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 07:19:42.019341 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.virt.hardware [None req-57c46ff1-ea9b-4298-af0a-10a4f0d89c9d tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Flavor pref 0:0:0 {{(pid=117858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 07:19:42.019804 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.virt.hardware [None req-57c46ff1-ea9b-4298-af0a-10a4f0d89c9d tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Image pref 0:0:0 {{(pid=117858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 07:19:42.020209 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.virt.hardware [None req-57c46ff1-ea9b-4298-af0a-10a4f0d89c9d tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 07:19:42.028852 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-57c46ff1-ea9b-4298-af0a-10a4f0d89c9d tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:19:42.029324 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-57c46ff1-ea9b-4298-af0a-10a4f0d89c9d tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:19:42.029751 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-57c46ff1-ea9b-4298-af0a-10a4f0d89c9d tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:19:42.030465 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-57c46ff1-ea9b-4298-af0a-10a4f0d89c9d tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:19:42.030985 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-57c46ff1-ea9b-4298-af0a-10a4f0d89c9d tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:19:42.031414 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-57c46ff1-ea9b-4298-af0a-10a4f0d89c9d tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:19:42.047603 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.quota [None req-57c46ff1-ea9b-4298-af0a-10a4f0d89c9d tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Getting quotas for project ac9f07b87ad643b58d21be9042b64c87. Resources: {'cores', 'instances', 'ram'} {{(pid=117858) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 07:19:42.051445 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.quota [None req-57c46ff1-ea9b-4298-af0a-10a4f0d89c9d tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Getting quotas for user cc228ac26c454318b15e1a2f198ebdf4 and project ac9f07b87ad643b58d21be9042b64c87. Resources: {'cores', 'instances', 'ram'} {{(pid=117858) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 07:19:42.107621 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-57c46ff1-ea9b-4298-af0a-10a4f0d89c9d tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Going to run 1 instances... {{(pid=117858) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 07:19:42.110394 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-57c46ff1-ea9b-4298-af0a-10a4f0d89c9d tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: ccb8da13-c579-4817-b66a-0db21be4b276] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fb4241c5-f2f1-4e2f-9e0c-42f1c034df14',volume_size=None,volume_type=None)] {{(pid=117858) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 07:19:42.236058 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-57c46ff1-ea9b-4298-af0a-10a4f0d89c9d tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.699654 Aug 09 07:19:42.236696 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 489/980] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 9 07:19:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 07:19:42.247174 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-8ea8e507-3654-4b69-8874-603e8fe4f6c3 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:19:42.247820 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-8ea8e507-3654-4b69-8874-603e8fe4f6c3 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: ccb8da13-c579-4817-b66a-0db21be4b276] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:19:42.304371 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8ea8e507-3654-4b69-8874-603e8fe4f6c3 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc228ac26c454318b15e1a2f198ebdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f07b87ad643b58d21be9042b64c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:19:42.311113 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-8ea8e507-3654-4b69-8874-603e8fe4f6c3 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "GET /compute/v2.1/servers/ccb8da13-c579-4817-b66a-0db21be4b276" status: 200 len: 1093 microversion: 2.1 time: 0.067739 Aug 09 07:19:42.312277 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 492/981] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:19:42 2022] GET /compute/v2.1/servers/ccb8da13-c579-4817-b66a-0db21be4b276 => generated 1093 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:19:43.332777 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-2407d0d2-88f7-4a45-8e9f-2c8b5c39154b tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:19:43.333542 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-2407d0d2-88f7-4a45-8e9f-2c8b5c39154b tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: ccb8da13-c579-4817-b66a-0db21be4b276] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:19:43.339621 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2407d0d2-88f7-4a45-8e9f-2c8b5c39154b tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:19:43.340187 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2407d0d2-88f7-4a45-8e9f-2c8b5c39154b tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:19:43.340621 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2407d0d2-88f7-4a45-8e9f-2c8b5c39154b tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:19:43.341314 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2407d0d2-88f7-4a45-8e9f-2c8b5c39154b tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:19:43.341778 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2407d0d2-88f7-4a45-8e9f-2c8b5c39154b tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:19:43.342190 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2407d0d2-88f7-4a45-8e9f-2c8b5c39154b tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:19:43.404174 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-2407d0d2-88f7-4a45-8e9f-2c8b5c39154b tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc228ac26c454318b15e1a2f198ebdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f07b87ad643b58d21be9042b64c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:19:43.412943 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-2407d0d2-88f7-4a45-8e9f-2c8b5c39154b tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "GET /compute/v2.1/servers/ccb8da13-c579-4817-b66a-0db21be4b276" status: 200 len: 1209 microversion: 2.1 time: 0.084682 Aug 09 07:19:43.413720 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 490/982] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:19:43 2022] GET /compute/v2.1/servers/ccb8da13-c579-4817-b66a-0db21be4b276 => generated 1209 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:19:44.435025 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d7de3095-52bb-4fd4-b12d-552ece14a87e tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:19:44.435770 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-d7de3095-52bb-4fd4-b12d-552ece14a87e tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: ccb8da13-c579-4817-b66a-0db21be4b276] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:19:44.445322 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d7de3095-52bb-4fd4-b12d-552ece14a87e tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:19:44.445806 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d7de3095-52bb-4fd4-b12d-552ece14a87e tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:19:44.446234 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d7de3095-52bb-4fd4-b12d-552ece14a87e tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:19:44.446932 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d7de3095-52bb-4fd4-b12d-552ece14a87e tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:19:44.447484 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d7de3095-52bb-4fd4-b12d-552ece14a87e tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:19:44.447937 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d7de3095-52bb-4fd4-b12d-552ece14a87e tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:19:44.589756 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d7de3095-52bb-4fd4-b12d-552ece14a87e tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc228ac26c454318b15e1a2f198ebdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f07b87ad643b58d21be9042b64c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:19:44.597586 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-d7de3095-52bb-4fd4-b12d-552ece14a87e tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "GET /compute/v2.1/servers/ccb8da13-c579-4817-b66a-0db21be4b276" status: 200 len: 1265 microversion: 2.1 time: 0.166614 Aug 09 07:19:44.598161 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 493/983] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:19:44 2022] GET /compute/v2.1/servers/ccb8da13-c579-4817-b66a-0db21be4b276 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:19:44.661707 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [req-b7f765b1-886d-441d-aafe-5311d0ec7bc8 req-4065c519-8e31-421c-873d-6b110c2950a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccb8da13-c579-4817-b66a-0db21be4b276", "tag": "d47cb641-9106-43c3-a6c5-1f214fa55441"}]} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:19:44.672718 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-b7f765b1-886d-441d-aafe-5311d0ec7bc8 req-4065c519-8e31-421c-873d-6b110c2950a1 service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:19:44.673294 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-b7f765b1-886d-441d-aafe-5311d0ec7bc8 req-4065c519-8e31-421c-873d-6b110c2950a1 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:19:44.673856 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-b7f765b1-886d-441d-aafe-5311d0ec7bc8 req-4065c519-8e31-421c-873d-6b110c2950a1 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:19:44.685212 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.compute.server_external_events [req-b7f765b1-886d-441d-aafe-5311d0ec7bc8 req-4065c519-8e31-421c-873d-6b110c2950a1 service nova] Creating event network-changed:d47cb641-9106-43c3-a6c5-1f214fa55441 for instance ccb8da13-c579-4817-b66a-0db21be4b276 on hv-cinder-85251 Aug 09 07:19:44.691452 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [req-b7f765b1-886d-441d-aafe-5311d0ec7bc8 req-4065c519-8e31-421c-873d-6b110c2950a1 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034120 Aug 09 07:19:44.692311 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 491/984] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:19:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 07:19:45.618175 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f0bd5a65-44e3-46e9-a0d9-876c8bd8d864 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:19:45.618761 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-f0bd5a65-44e3-46e9-a0d9-876c8bd8d864 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: ccb8da13-c579-4817-b66a-0db21be4b276] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:19:45.625923 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f0bd5a65-44e3-46e9-a0d9-876c8bd8d864 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:19:45.626399 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f0bd5a65-44e3-46e9-a0d9-876c8bd8d864 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:19:45.626828 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f0bd5a65-44e3-46e9-a0d9-876c8bd8d864 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:19:45.627739 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f0bd5a65-44e3-46e9-a0d9-876c8bd8d864 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:19:45.628189 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f0bd5a65-44e3-46e9-a0d9-876c8bd8d864 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:19:45.628609 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f0bd5a65-44e3-46e9-a0d9-876c8bd8d864 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:19:45.761587 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-f0bd5a65-44e3-46e9-a0d9-876c8bd8d864 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc228ac26c454318b15e1a2f198ebdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f07b87ad643b58d21be9042b64c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:19:45.769228 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f0bd5a65-44e3-46e9-a0d9-876c8bd8d864 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "GET /compute/v2.1/servers/ccb8da13-c579-4817-b66a-0db21be4b276" status: 200 len: 1265 microversion: 2.1 time: 0.154898 Aug 09 07:19:45.769789 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 494/985] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:19:45 2022] GET /compute/v2.1/servers/ccb8da13-c579-4817-b66a-0db21be4b276 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:19:46.791232 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-b8760cfd-8a83-444b-befc-1edcbc6c6f3b tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:19:46.791941 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-b8760cfd-8a83-444b-befc-1edcbc6c6f3b tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: ccb8da13-c579-4817-b66a-0db21be4b276] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:19:46.798293 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b8760cfd-8a83-444b-befc-1edcbc6c6f3b tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:19:46.798769 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b8760cfd-8a83-444b-befc-1edcbc6c6f3b tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:19:46.799198 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b8760cfd-8a83-444b-befc-1edcbc6c6f3b tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:19:46.799907 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b8760cfd-8a83-444b-befc-1edcbc6c6f3b tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:19:46.800355 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b8760cfd-8a83-444b-befc-1edcbc6c6f3b tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:19:46.800772 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-b8760cfd-8a83-444b-befc-1edcbc6c6f3b tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:19:46.933539 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-b8760cfd-8a83-444b-befc-1edcbc6c6f3b tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc228ac26c454318b15e1a2f198ebdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f07b87ad643b58d21be9042b64c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:19:46.941641 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-b8760cfd-8a83-444b-befc-1edcbc6c6f3b tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "GET /compute/v2.1/servers/ccb8da13-c579-4817-b66a-0db21be4b276" status: 200 len: 1265 microversion: 2.1 time: 0.155230 Aug 09 07:19:46.942205 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 492/986] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:19:46 2022] GET /compute/v2.1/servers/ccb8da13-c579-4817-b66a-0db21be4b276 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:19:47.962444 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c8bd6377-a578-4eef-aeec-94945373827f tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:19:47.963049 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c8bd6377-a578-4eef-aeec-94945373827f tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: ccb8da13-c579-4817-b66a-0db21be4b276] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:19:47.970016 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c8bd6377-a578-4eef-aeec-94945373827f tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:19:47.970574 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c8bd6377-a578-4eef-aeec-94945373827f tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:19:47.971006 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c8bd6377-a578-4eef-aeec-94945373827f tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:19:47.971711 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c8bd6377-a578-4eef-aeec-94945373827f tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:19:47.972158 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c8bd6377-a578-4eef-aeec-94945373827f tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:19:47.972574 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c8bd6377-a578-4eef-aeec-94945373827f tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:19:48.104337 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c8bd6377-a578-4eef-aeec-94945373827f tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc228ac26c454318b15e1a2f198ebdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f07b87ad643b58d21be9042b64c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:19:48.111790 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c8bd6377-a578-4eef-aeec-94945373827f tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "GET /compute/v2.1/servers/ccb8da13-c579-4817-b66a-0db21be4b276" status: 200 len: 1265 microversion: 2.1 time: 0.153140 Aug 09 07:19:48.112292 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 495/987] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:19:47 2022] GET /compute/v2.1/servers/ccb8da13-c579-4817-b66a-0db21be4b276 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:19:49.132563 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-32cc7d2c-478a-4bca-ab53-cd9377bae74a tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:19:49.133353 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-32cc7d2c-478a-4bca-ab53-cd9377bae74a tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: ccb8da13-c579-4817-b66a-0db21be4b276] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:19:49.139824 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-32cc7d2c-478a-4bca-ab53-cd9377bae74a tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:19:49.140302 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-32cc7d2c-478a-4bca-ab53-cd9377bae74a tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:19:49.140735 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-32cc7d2c-478a-4bca-ab53-cd9377bae74a tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:19:49.141923 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-32cc7d2c-478a-4bca-ab53-cd9377bae74a tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:19:49.142372 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-32cc7d2c-478a-4bca-ab53-cd9377bae74a tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:19:49.142793 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-32cc7d2c-478a-4bca-ab53-cd9377bae74a tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:19:49.419443 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-32cc7d2c-478a-4bca-ab53-cd9377bae74a tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc228ac26c454318b15e1a2f198ebdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f07b87ad643b58d21be9042b64c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:19:49.427964 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-32cc7d2c-478a-4bca-ab53-cd9377bae74a tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "GET /compute/v2.1/servers/ccb8da13-c579-4817-b66a-0db21be4b276" status: 200 len: 1265 microversion: 2.1 time: 0.299416 Aug 09 07:19:49.428514 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 493/988] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:19:49 2022] GET /compute/v2.1/servers/ccb8da13-c579-4817-b66a-0db21be4b276 => generated 1265 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:19:50.448701 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-34dbb887-6e9f-47b8-a7f5-082dde388f26 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:19:50.449313 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-34dbb887-6e9f-47b8-a7f5-082dde388f26 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: ccb8da13-c579-4817-b66a-0db21be4b276] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:19:50.455996 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-34dbb887-6e9f-47b8-a7f5-082dde388f26 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:19:50.456476 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-34dbb887-6e9f-47b8-a7f5-082dde388f26 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:19:50.456911 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-34dbb887-6e9f-47b8-a7f5-082dde388f26 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:19:50.457603 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-34dbb887-6e9f-47b8-a7f5-082dde388f26 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:19:50.458083 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-34dbb887-6e9f-47b8-a7f5-082dde388f26 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:19:50.458510 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-34dbb887-6e9f-47b8-a7f5-082dde388f26 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:19:50.589038 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-34dbb887-6e9f-47b8-a7f5-082dde388f26 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc228ac26c454318b15e1a2f198ebdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f07b87ad643b58d21be9042b64c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:19:50.596756 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-34dbb887-6e9f-47b8-a7f5-082dde388f26 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "GET /compute/v2.1/servers/ccb8da13-c579-4817-b66a-0db21be4b276" status: 200 len: 1265 microversion: 2.1 time: 0.151897 Aug 09 07:19:50.597240 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 496/989] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:19:50 2022] GET /compute/v2.1/servers/ccb8da13-c579-4817-b66a-0db21be4b276 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:19:51.616536 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-f9c45cd7-c41e-4a07-82a2-550727a430aa tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:19:51.617141 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-f9c45cd7-c41e-4a07-82a2-550727a430aa tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: ccb8da13-c579-4817-b66a-0db21be4b276] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:19:51.623482 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f9c45cd7-c41e-4a07-82a2-550727a430aa tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:19:51.623980 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f9c45cd7-c41e-4a07-82a2-550727a430aa tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:19:51.624410 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f9c45cd7-c41e-4a07-82a2-550727a430aa tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:19:51.625083 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f9c45cd7-c41e-4a07-82a2-550727a430aa tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:19:51.626232 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f9c45cd7-c41e-4a07-82a2-550727a430aa tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:19:51.626778 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-f9c45cd7-c41e-4a07-82a2-550727a430aa tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:19:51.756677 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-f9c45cd7-c41e-4a07-82a2-550727a430aa tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc228ac26c454318b15e1a2f198ebdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f07b87ad643b58d21be9042b64c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:19:51.764270 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-f9c45cd7-c41e-4a07-82a2-550727a430aa tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "GET /compute/v2.1/servers/ccb8da13-c579-4817-b66a-0db21be4b276" status: 200 len: 1265 microversion: 2.1 time: 0.151533 Aug 09 07:19:51.764822 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 494/990] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:19:51 2022] GET /compute/v2.1/servers/ccb8da13-c579-4817-b66a-0db21be4b276 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:19:52.786128 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b97f7cf6-950e-4ab8-8949-987abd287f67 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:19:52.786735 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b97f7cf6-950e-4ab8-8949-987abd287f67 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: ccb8da13-c579-4817-b66a-0db21be4b276] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:19:52.789157 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=2 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:19:52.794674 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b97f7cf6-950e-4ab8-8949-987abd287f67 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:19:52.795148 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b97f7cf6-950e-4ab8-8949-987abd287f67 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:19:52.795580 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b97f7cf6-950e-4ab8-8949-987abd287f67 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:19:52.796282 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b97f7cf6-950e-4ab8-8949-987abd287f67 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:19:52.796732 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b97f7cf6-950e-4ab8-8949-987abd287f67 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:19:52.798162 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b97f7cf6-950e-4ab8-8949-987abd287f67 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:19:52.931440 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b97f7cf6-950e-4ab8-8949-987abd287f67 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc228ac26c454318b15e1a2f198ebdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f07b87ad643b58d21be9042b64c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:19:52.938956 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b97f7cf6-950e-4ab8-8949-987abd287f67 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "GET /compute/v2.1/servers/ccb8da13-c579-4817-b66a-0db21be4b276" status: 200 len: 1265 microversion: 2.1 time: 0.157280 Aug 09 07:19:52.939626 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 497/991] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:19:52 2022] GET /compute/v2.1/servers/ccb8da13-c579-4817-b66a-0db21be4b276 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:19:53.959752 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-bff86884-2630-4edf-a8a7-413faa82cf36 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:19:53.960451 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-bff86884-2630-4edf-a8a7-413faa82cf36 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: ccb8da13-c579-4817-b66a-0db21be4b276] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:19:53.962348 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_cell0:SELECT=2 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:19:53.963134 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_cell0:SELECT=6 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:19:53.969656 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-bff86884-2630-4edf-a8a7-413faa82cf36 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:19:53.970415 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-bff86884-2630-4edf-a8a7-413faa82cf36 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:19:53.970854 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-bff86884-2630-4edf-a8a7-413faa82cf36 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:19:53.971544 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-bff86884-2630-4edf-a8a7-413faa82cf36 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:19:53.972022 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-bff86884-2630-4edf-a8a7-413faa82cf36 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:19:53.972442 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-bff86884-2630-4edf-a8a7-413faa82cf36 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:19:54.104178 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-bff86884-2630-4edf-a8a7-413faa82cf36 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc228ac26c454318b15e1a2f198ebdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f07b87ad643b58d21be9042b64c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:19:54.111941 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-bff86884-2630-4edf-a8a7-413faa82cf36 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "GET /compute/v2.1/servers/ccb8da13-c579-4817-b66a-0db21be4b276" status: 200 len: 1265 microversion: 2.1 time: 0.156048 Aug 09 07:19:54.112430 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 495/992] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:19:53 2022] GET /compute/v2.1/servers/ccb8da13-c579-4817-b66a-0db21be4b276 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:19:55.132681 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b2082041-a00f-4c62-9df1-c772712bba0d tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:19:55.133498 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b2082041-a00f-4c62-9df1-c772712bba0d tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: ccb8da13-c579-4817-b66a-0db21be4b276] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:19:55.139877 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b2082041-a00f-4c62-9df1-c772712bba0d tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:19:55.140362 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b2082041-a00f-4c62-9df1-c772712bba0d tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:19:55.141381 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b2082041-a00f-4c62-9df1-c772712bba0d tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:19:55.142176 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b2082041-a00f-4c62-9df1-c772712bba0d tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:19:55.142636 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b2082041-a00f-4c62-9df1-c772712bba0d tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:19:55.143065 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b2082041-a00f-4c62-9df1-c772712bba0d tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:19:55.181272 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [req-b1a2f5e1-e7ea-440b-a28e-03965a1c69e6 req-f3f8dfdc-009e-41e8-a9b2-4f99a3c2e33b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccb8da13-c579-4817-b66a-0db21be4b276", "name": "network-vif-plugged", "status": "completed", "tag": "d47cb641-9106-43c3-a6c5-1f214fa55441"}]} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:19:55.193326 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-b1a2f5e1-e7ea-440b-a28e-03965a1c69e6 req-f3f8dfdc-009e-41e8-a9b2-4f99a3c2e33b service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:19:55.194023 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-b1a2f5e1-e7ea-440b-a28e-03965a1c69e6 req-f3f8dfdc-009e-41e8-a9b2-4f99a3c2e33b service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:19:55.194847 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-b1a2f5e1-e7ea-440b-a28e-03965a1c69e6 req-f3f8dfdc-009e-41e8-a9b2-4f99a3c2e33b service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:19:55.209371 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.compute.server_external_events [req-b1a2f5e1-e7ea-440b-a28e-03965a1c69e6 req-f3f8dfdc-009e-41e8-a9b2-4f99a3c2e33b service nova] Creating event network-vif-plugged:d47cb641-9106-43c3-a6c5-1f214fa55441 for instance ccb8da13-c579-4817-b66a-0db21be4b276 on hv-cinder-85251 Aug 09 07:19:55.215366 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [req-b1a2f5e1-e7ea-440b-a28e-03965a1c69e6 req-f3f8dfdc-009e-41e8-a9b2-4f99a3c2e33b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037178 Aug 09 07:19:55.216302 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 496/993] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:19:55.283506 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b2082041-a00f-4c62-9df1-c772712bba0d tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc228ac26c454318b15e1a2f198ebdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f07b87ad643b58d21be9042b64c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:19:55.290878 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b2082041-a00f-4c62-9df1-c772712bba0d tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "GET /compute/v2.1/servers/ccb8da13-c579-4817-b66a-0db21be4b276" status: 200 len: 1265 microversion: 2.1 time: 0.162180 Aug 09 07:19:55.291433 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 498/994] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:19:55 2022] GET /compute/v2.1/servers/ccb8da13-c579-4817-b66a-0db21be4b276 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:19:56.313881 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-a9389f1b-efd0-4d51-934e-5c7c45e1f040 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:19:56.314585 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-a9389f1b-efd0-4d51-934e-5c7c45e1f040 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: ccb8da13-c579-4817-b66a-0db21be4b276] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:19:56.320661 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a9389f1b-efd0-4d51-934e-5c7c45e1f040 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:19:56.321138 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a9389f1b-efd0-4d51-934e-5c7c45e1f040 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:19:56.321575 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a9389f1b-efd0-4d51-934e-5c7c45e1f040 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:19:56.322257 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a9389f1b-efd0-4d51-934e-5c7c45e1f040 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:19:56.322711 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a9389f1b-efd0-4d51-934e-5c7c45e1f040 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:19:56.323136 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a9389f1b-efd0-4d51-934e-5c7c45e1f040 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:19:56.454630 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-a9389f1b-efd0-4d51-934e-5c7c45e1f040 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc228ac26c454318b15e1a2f198ebdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f07b87ad643b58d21be9042b64c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:19:56.462036 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-a9389f1b-efd0-4d51-934e-5c7c45e1f040 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "GET /compute/v2.1/servers/ccb8da13-c579-4817-b66a-0db21be4b276" status: 200 len: 1265 microversion: 2.1 time: 0.153488 Aug 09 07:19:56.462590 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 497/995] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:19:56 2022] GET /compute/v2.1/servers/ccb8da13-c579-4817-b66a-0db21be4b276 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:19:57.482255 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-cab978b4-ecf5-4156-a86c-afb812f023a8 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:19:57.482902 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-cab978b4-ecf5-4156-a86c-afb812f023a8 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: ccb8da13-c579-4817-b66a-0db21be4b276] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:19:57.489404 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cab978b4-ecf5-4156-a86c-afb812f023a8 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:19:57.489887 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cab978b4-ecf5-4156-a86c-afb812f023a8 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:19:57.490325 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cab978b4-ecf5-4156-a86c-afb812f023a8 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:19:57.491014 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cab978b4-ecf5-4156-a86c-afb812f023a8 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:19:57.491474 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cab978b4-ecf5-4156-a86c-afb812f023a8 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:19:57.491930 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cab978b4-ecf5-4156-a86c-afb812f023a8 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:19:57.619379 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-cab978b4-ecf5-4156-a86c-afb812f023a8 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc228ac26c454318b15e1a2f198ebdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f07b87ad643b58d21be9042b64c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:19:57.627409 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-cab978b4-ecf5-4156-a86c-afb812f023a8 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "GET /compute/v2.1/servers/ccb8da13-c579-4817-b66a-0db21be4b276" status: 200 len: 1453 microversion: 2.1 time: 0.149022 Aug 09 07:19:57.628010 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 499/996] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:19:57 2022] GET /compute/v2.1/servers/ccb8da13-c579-4817-b66a-0db21be4b276 => generated 1453 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:19:57.647841 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-2f4e4303-8c30-4ead-8d2e-dfdc3ea82660 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:19:57.648460 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-2f4e4303-8c30-4ead-8d2e-dfdc3ea82660 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: ccb8da13-c579-4817-b66a-0db21be4b276] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:19:57.654716 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2f4e4303-8c30-4ead-8d2e-dfdc3ea82660 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:19:57.655196 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2f4e4303-8c30-4ead-8d2e-dfdc3ea82660 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:19:57.655660 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2f4e4303-8c30-4ead-8d2e-dfdc3ea82660 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:19:57.656353 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2f4e4303-8c30-4ead-8d2e-dfdc3ea82660 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:19:57.656810 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2f4e4303-8c30-4ead-8d2e-dfdc3ea82660 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:19:57.657233 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-2f4e4303-8c30-4ead-8d2e-dfdc3ea82660 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:19:57.788786 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-2f4e4303-8c30-4ead-8d2e-dfdc3ea82660 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc228ac26c454318b15e1a2f198ebdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f07b87ad643b58d21be9042b64c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:19:57.796190 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-2f4e4303-8c30-4ead-8d2e-dfdc3ea82660 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "GET /compute/v2.1/servers/ccb8da13-c579-4817-b66a-0db21be4b276" status: 200 len: 1453 microversion: 2.1 time: 0.152316 Aug 09 07:19:57.796750 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 498/997] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:19:57 2022] GET /compute/v2.1/servers/ccb8da13-c579-4817-b66a-0db21be4b276 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:19:59.602429 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-7e27c71f-7ed0-4d97-89cd-ad3b434203c1 req-b387be53-4bdd-4ecc-bec1-f8f010c0239a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccb8da13-c579-4817-b66a-0db21be4b276", "tag": "d47cb641-9106-43c3-a6c5-1f214fa55441"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:19:59.612853 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-7e27c71f-7ed0-4d97-89cd-ad3b434203c1 req-b387be53-4bdd-4ecc-bec1-f8f010c0239a service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:19:59.613416 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-7e27c71f-7ed0-4d97-89cd-ad3b434203c1 req-b387be53-4bdd-4ecc-bec1-f8f010c0239a service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:19:59.613920 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-7e27c71f-7ed0-4d97-89cd-ad3b434203c1 req-b387be53-4bdd-4ecc-bec1-f8f010c0239a service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:19:59.624900 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-7e27c71f-7ed0-4d97-89cd-ad3b434203c1 req-b387be53-4bdd-4ecc-bec1-f8f010c0239a service nova] Creating event network-changed:d47cb641-9106-43c3-a6c5-1f214fa55441 for instance ccb8da13-c579-4817-b66a-0db21be4b276 on hv-cinder-85251 Aug 09 07:19:59.630755 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-7e27c71f-7ed0-4d97-89cd-ad3b434203c1 req-b387be53-4bdd-4ecc-bec1-f8f010c0239a service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031975 Aug 09 07:19:59.631780 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 500/998] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:21:33.837662 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-a6dc91d3-1de4-42f5-934c-4719702760a9 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-251285364", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-35902457", "security_groups": [{"name": "tempest-secgroup-smoke-1429632898"}], "block_device_mapping_v2": [{"uuid": "431208e9-5358-486a-b74b-033aa90c80ae", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4524a8ed-4b7c-43d5-97a8-67c6f1afc01e"}]}} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:21:33.847683 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:21:33.848345 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:21:33.953507 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.network.neutron [None req-a6dc91d3-1de4-42f5-934c-4719702760a9 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] validate_networks() for [('4524a8ed-4b7c-43d5-97a8-67c6f1afc01e', None, None, None, None, None)] {{(pid=117858) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 09 07:21:34.314701 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.virt.hardware [None req-a6dc91d3-1de4-42f5-934c-4719702760a9 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Flavor limits 0:0:0 {{(pid=117858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 09 07:21:34.315206 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.virt.hardware [None req-a6dc91d3-1de4-42f5-934c-4719702760a9 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Image limits 0:0:0 {{(pid=117858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 09 07:21:34.315717 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.virt.hardware [None req-a6dc91d3-1de4-42f5-934c-4719702760a9 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Flavor pref 0:0:0 {{(pid=117858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 09 07:21:34.316131 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.virt.hardware [None req-a6dc91d3-1de4-42f5-934c-4719702760a9 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Image pref 0:0:0 {{(pid=117858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 09 07:21:34.316542 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.virt.hardware [None req-a6dc91d3-1de4-42f5-934c-4719702760a9 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117858) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 09 07:21:34.325280 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a6dc91d3-1de4-42f5-934c-4719702760a9 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:21:34.325758 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a6dc91d3-1de4-42f5-934c-4719702760a9 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:21:34.326193 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a6dc91d3-1de4-42f5-934c-4719702760a9 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:21:34.326913 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a6dc91d3-1de4-42f5-934c-4719702760a9 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:21:34.327365 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a6dc91d3-1de4-42f5-934c-4719702760a9 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:21:34.327830 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-a6dc91d3-1de4-42f5-934c-4719702760a9 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:21:34.344764 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.quota [None req-a6dc91d3-1de4-42f5-934c-4719702760a9 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Getting quotas for project ac9f07b87ad643b58d21be9042b64c87. Resources: {'cores', 'instances', 'ram'} {{(pid=117858) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 09 07:21:34.348707 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.quota [None req-a6dc91d3-1de4-42f5-934c-4719702760a9 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Getting quotas for user cc228ac26c454318b15e1a2f198ebdf4 and project ac9f07b87ad643b58d21be9042b64c87. Resources: {'cores', 'instances', 'ram'} {{(pid=117858) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 09 07:21:34.406394 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-a6dc91d3-1de4-42f5-934c-4719702760a9 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Going to run 1 instances... {{(pid=117858) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 09 07:21:34.408620 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-a6dc91d3-1de4-42f5-934c-4719702760a9 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: c79cac58-3818-4e93-adda-6cd824a32dca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='431208e9-5358-486a-b74b-033aa90c80ae',volume_size=None,volume_type=None)] {{(pid=117858) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 09 07:21:34.540663 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-a6dc91d3-1de4-42f5-934c-4719702760a9 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.707458 Aug 09 07:21:34.541291 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 499/999] 10.222.0.30 () {60 vars in 1147 bytes} [Tue Aug 9 07:21:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 09 07:21:34.551272 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=26 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:21:34.552027 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=54 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:21:34.556551 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-ee806475-434e-468a-bd41-01f5e1be584c tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:21:34.562267 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-ee806475-434e-468a-bd41-01f5e1be584c tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: c79cac58-3818-4e93-adda-6cd824a32dca] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:21:34.617737 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ee806475-434e-468a-bd41-01f5e1be584c tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc228ac26c454318b15e1a2f198ebdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f07b87ad643b58d21be9042b64c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:21:34.624397 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-ee806475-434e-468a-bd41-01f5e1be584c tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "GET /compute/v2.1/servers/c79cac58-3818-4e93-adda-6cd824a32dca" status: 200 len: 1092 microversion: 2.1 time: 0.076056 Aug 09 07:21:34.625185 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 501/1000] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:21:34 2022] GET /compute/v2.1/servers/c79cac58-3818-4e93-adda-6cd824a32dca => generated 1092 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:21:35.646982 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-7542ab35-ff50-44b4-8c65-5248fff60202 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:21:35.648319 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-7542ab35-ff50-44b4-8c65-5248fff60202 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: c79cac58-3818-4e93-adda-6cd824a32dca] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:21:35.654837 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7542ab35-ff50-44b4-8c65-5248fff60202 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:21:35.655575 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7542ab35-ff50-44b4-8c65-5248fff60202 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:21:35.656043 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7542ab35-ff50-44b4-8c65-5248fff60202 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:21:35.656745 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7542ab35-ff50-44b4-8c65-5248fff60202 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:21:35.657195 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7542ab35-ff50-44b4-8c65-5248fff60202 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:21:35.658147 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-7542ab35-ff50-44b4-8c65-5248fff60202 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:21:35.723932 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-7542ab35-ff50-44b4-8c65-5248fff60202 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc228ac26c454318b15e1a2f198ebdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f07b87ad643b58d21be9042b64c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:21:35.732287 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-7542ab35-ff50-44b4-8c65-5248fff60202 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "GET /compute/v2.1/servers/c79cac58-3818-4e93-adda-6cd824a32dca" status: 200 len: 1208 microversion: 2.1 time: 0.090277 Aug 09 07:21:35.733082 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 500/1001] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:21:35 2022] GET /compute/v2.1/servers/c79cac58-3818-4e93-adda-6cd824a32dca => generated 1208 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:21:36.753209 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-0df9f830-bbdb-4b67-9813-43e1d3954fc7 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:21:36.754420 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-0df9f830-bbdb-4b67-9813-43e1d3954fc7 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: c79cac58-3818-4e93-adda-6cd824a32dca] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:21:36.761689 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0df9f830-bbdb-4b67-9813-43e1d3954fc7 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:21:36.762170 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0df9f830-bbdb-4b67-9813-43e1d3954fc7 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:21:36.762602 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0df9f830-bbdb-4b67-9813-43e1d3954fc7 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:21:36.763713 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0df9f830-bbdb-4b67-9813-43e1d3954fc7 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:21:36.764077 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0df9f830-bbdb-4b67-9813-43e1d3954fc7 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:21:36.764497 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0df9f830-bbdb-4b67-9813-43e1d3954fc7 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:21:36.901782 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-0df9f830-bbdb-4b67-9813-43e1d3954fc7 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc228ac26c454318b15e1a2f198ebdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f07b87ad643b58d21be9042b64c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:21:36.910860 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-0df9f830-bbdb-4b67-9813-43e1d3954fc7 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "GET /compute/v2.1/servers/c79cac58-3818-4e93-adda-6cd824a32dca" status: 200 len: 1264 microversion: 2.1 time: 0.161474 Aug 09 07:21:36.911440 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 502/1002] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:21:36 2022] GET /compute/v2.1/servers/c79cac58-3818-4e93-adda-6cd824a32dca => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:21:36.929795 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [req-634aa4b0-d189-4060-9db2-383171b0b587 req-ea1b2e86-57cf-4578-9a67-77c21510e70e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c79cac58-3818-4e93-adda-6cd824a32dca", "tag": "22a341e9-50c5-49e7-be5e-88519cb1526a"}]} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:21:36.941149 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-634aa4b0-d189-4060-9db2-383171b0b587 req-ea1b2e86-57cf-4578-9a67-77c21510e70e service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:21:36.941630 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-634aa4b0-d189-4060-9db2-383171b0b587 req-ea1b2e86-57cf-4578-9a67-77c21510e70e service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:21:36.942061 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-634aa4b0-d189-4060-9db2-383171b0b587 req-ea1b2e86-57cf-4578-9a67-77c21510e70e service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:21:36.953244 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.compute.server_external_events [req-634aa4b0-d189-4060-9db2-383171b0b587 req-ea1b2e86-57cf-4578-9a67-77c21510e70e service nova] Creating event network-changed:22a341e9-50c5-49e7-be5e-88519cb1526a for instance c79cac58-3818-4e93-adda-6cd824a32dca on hv-cinder-85251 Aug 09 07:21:36.958053 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [req-634aa4b0-d189-4060-9db2-383171b0b587 req-ea1b2e86-57cf-4578-9a67-77c21510e70e service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032211 Aug 09 07:21:36.958642 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 501/1003] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:21:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 07:21:37.932187 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-0a057e0f-835b-4ded-a704-294fe7a92cae tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:21:37.932839 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-0a057e0f-835b-4ded-a704-294fe7a92cae tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: c79cac58-3818-4e93-adda-6cd824a32dca] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:21:37.939693 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0a057e0f-835b-4ded-a704-294fe7a92cae tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:21:37.940185 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0a057e0f-835b-4ded-a704-294fe7a92cae tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:21:37.940622 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0a057e0f-835b-4ded-a704-294fe7a92cae tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:21:37.941325 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0a057e0f-835b-4ded-a704-294fe7a92cae tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:21:37.941778 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0a057e0f-835b-4ded-a704-294fe7a92cae tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:21:37.942207 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0a057e0f-835b-4ded-a704-294fe7a92cae tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:21:38.072728 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-0a057e0f-835b-4ded-a704-294fe7a92cae tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc228ac26c454318b15e1a2f198ebdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f07b87ad643b58d21be9042b64c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:21:38.081373 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-0a057e0f-835b-4ded-a704-294fe7a92cae tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "GET /compute/v2.1/servers/c79cac58-3818-4e93-adda-6cd824a32dca" status: 200 len: 1264 microversion: 2.1 time: 0.153032 Aug 09 07:21:38.081945 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 503/1004] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:21:37 2022] GET /compute/v2.1/servers/c79cac58-3818-4e93-adda-6cd824a32dca => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:21:39.103079 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-0154116e-3846-4bfb-9256-730d161a9df6 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:21:39.103751 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-0154116e-3846-4bfb-9256-730d161a9df6 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: c79cac58-3818-4e93-adda-6cd824a32dca] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:21:39.109929 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0154116e-3846-4bfb-9256-730d161a9df6 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:21:39.110407 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0154116e-3846-4bfb-9256-730d161a9df6 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:21:39.111544 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0154116e-3846-4bfb-9256-730d161a9df6 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:21:39.112421 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0154116e-3846-4bfb-9256-730d161a9df6 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:21:39.112878 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0154116e-3846-4bfb-9256-730d161a9df6 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:21:39.113299 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0154116e-3846-4bfb-9256-730d161a9df6 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:21:39.246582 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-0154116e-3846-4bfb-9256-730d161a9df6 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc228ac26c454318b15e1a2f198ebdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f07b87ad643b58d21be9042b64c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:21:39.254555 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-0154116e-3846-4bfb-9256-730d161a9df6 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "GET /compute/v2.1/servers/c79cac58-3818-4e93-adda-6cd824a32dca" status: 200 len: 1264 microversion: 2.1 time: 0.156239 Aug 09 07:21:39.255105 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 502/1005] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:21:39 2022] GET /compute/v2.1/servers/c79cac58-3818-4e93-adda-6cd824a32dca => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:21:40.275260 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6fceb21a-cefe-449e-88c4-9dfcf0da8e80 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:21:40.275901 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-6fceb21a-cefe-449e-88c4-9dfcf0da8e80 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: c79cac58-3818-4e93-adda-6cd824a32dca] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:21:40.281796 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6fceb21a-cefe-449e-88c4-9dfcf0da8e80 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:21:40.282267 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6fceb21a-cefe-449e-88c4-9dfcf0da8e80 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:21:40.283201 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6fceb21a-cefe-449e-88c4-9dfcf0da8e80 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:21:40.283903 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6fceb21a-cefe-449e-88c4-9dfcf0da8e80 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:21:40.284353 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6fceb21a-cefe-449e-88c4-9dfcf0da8e80 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:21:40.284769 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6fceb21a-cefe-449e-88c4-9dfcf0da8e80 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:21:40.412654 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6fceb21a-cefe-449e-88c4-9dfcf0da8e80 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc228ac26c454318b15e1a2f198ebdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f07b87ad643b58d21be9042b64c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:21:40.420687 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-6fceb21a-cefe-449e-88c4-9dfcf0da8e80 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "GET /compute/v2.1/servers/c79cac58-3818-4e93-adda-6cd824a32dca" status: 200 len: 1264 microversion: 2.1 time: 0.149401 Aug 09 07:21:40.421248 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 504/1006] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:21:40 2022] GET /compute/v2.1/servers/c79cac58-3818-4e93-adda-6cd824a32dca => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:21:41.442209 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-5ff689dc-837a-4937-9c99-664c6527827e tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:21:41.442801 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-5ff689dc-837a-4937-9c99-664c6527827e tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: c79cac58-3818-4e93-adda-6cd824a32dca] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:21:41.449192 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5ff689dc-837a-4937-9c99-664c6527827e tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:21:41.449666 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5ff689dc-837a-4937-9c99-664c6527827e tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:21:41.450093 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5ff689dc-837a-4937-9c99-664c6527827e tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:21:41.450771 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5ff689dc-837a-4937-9c99-664c6527827e tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:21:41.451218 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5ff689dc-837a-4937-9c99-664c6527827e tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:21:41.451663 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-5ff689dc-837a-4937-9c99-664c6527827e tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:21:41.579703 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-5ff689dc-837a-4937-9c99-664c6527827e tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc228ac26c454318b15e1a2f198ebdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f07b87ad643b58d21be9042b64c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:21:41.587508 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-5ff689dc-837a-4937-9c99-664c6527827e tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "GET /compute/v2.1/servers/c79cac58-3818-4e93-adda-6cd824a32dca" status: 200 len: 1264 microversion: 2.1 time: 0.149724 Aug 09 07:21:41.588091 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 503/1007] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:21:41 2022] GET /compute/v2.1/servers/c79cac58-3818-4e93-adda-6cd824a32dca => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:21:42.608475 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-30c8ed8d-e9b4-46f4-8dd0-1648998da84e tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:21:42.609081 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-30c8ed8d-e9b4-46f4-8dd0-1648998da84e tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: c79cac58-3818-4e93-adda-6cd824a32dca] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:21:42.615820 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-30c8ed8d-e9b4-46f4-8dd0-1648998da84e tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:21:42.616293 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-30c8ed8d-e9b4-46f4-8dd0-1648998da84e tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:21:42.616720 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-30c8ed8d-e9b4-46f4-8dd0-1648998da84e tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:21:42.617396 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-30c8ed8d-e9b4-46f4-8dd0-1648998da84e tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:21:42.617841 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-30c8ed8d-e9b4-46f4-8dd0-1648998da84e tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:21:42.618256 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-30c8ed8d-e9b4-46f4-8dd0-1648998da84e tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:21:42.751951 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-30c8ed8d-e9b4-46f4-8dd0-1648998da84e tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc228ac26c454318b15e1a2f198ebdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f07b87ad643b58d21be9042b64c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:21:42.760229 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-30c8ed8d-e9b4-46f4-8dd0-1648998da84e tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "GET /compute/v2.1/servers/c79cac58-3818-4e93-adda-6cd824a32dca" status: 200 len: 1264 microversion: 2.1 time: 0.155719 Aug 09 07:21:42.760797 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 505/1008] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:21:42 2022] GET /compute/v2.1/servers/c79cac58-3818-4e93-adda-6cd824a32dca => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 09 07:21:43.780241 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-413a7fd1-3fe1-4d15-856b-4951b0f4b3cb tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:21:43.780840 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-413a7fd1-3fe1-4d15-856b-4951b0f4b3cb tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: c79cac58-3818-4e93-adda-6cd824a32dca] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:21:43.787889 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-413a7fd1-3fe1-4d15-856b-4951b0f4b3cb tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:21:43.788374 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-413a7fd1-3fe1-4d15-856b-4951b0f4b3cb tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:21:43.788808 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-413a7fd1-3fe1-4d15-856b-4951b0f4b3cb tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:21:43.789497 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-413a7fd1-3fe1-4d15-856b-4951b0f4b3cb tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:21:43.789948 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-413a7fd1-3fe1-4d15-856b-4951b0f4b3cb tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:21:43.790372 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-413a7fd1-3fe1-4d15-856b-4951b0f4b3cb tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:21:43.919687 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-413a7fd1-3fe1-4d15-856b-4951b0f4b3cb tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc228ac26c454318b15e1a2f198ebdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f07b87ad643b58d21be9042b64c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:21:43.927130 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-413a7fd1-3fe1-4d15-856b-4951b0f4b3cb tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "GET /compute/v2.1/servers/c79cac58-3818-4e93-adda-6cd824a32dca" status: 200 len: 1264 microversion: 2.1 time: 0.150800 Aug 09 07:21:43.927705 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 504/1009] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:21:43 2022] GET /compute/v2.1/servers/c79cac58-3818-4e93-adda-6cd824a32dca => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:21:44.948354 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-eb61875d-bc2e-490f-8064-abc82ba6ff60 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:21:44.948958 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-eb61875d-bc2e-490f-8064-abc82ba6ff60 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: c79cac58-3818-4e93-adda-6cd824a32dca] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:21:44.951283 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=2 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:21:44.957129 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-eb61875d-bc2e-490f-8064-abc82ba6ff60 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:21:44.957601 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-eb61875d-bc2e-490f-8064-abc82ba6ff60 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:21:44.958031 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-eb61875d-bc2e-490f-8064-abc82ba6ff60 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:21:44.958707 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-eb61875d-bc2e-490f-8064-abc82ba6ff60 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:21:44.959154 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-eb61875d-bc2e-490f-8064-abc82ba6ff60 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:21:44.959573 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-eb61875d-bc2e-490f-8064-abc82ba6ff60 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:21:45.094529 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-eb61875d-bc2e-490f-8064-abc82ba6ff60 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc228ac26c454318b15e1a2f198ebdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f07b87ad643b58d21be9042b64c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:21:45.102920 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-eb61875d-bc2e-490f-8064-abc82ba6ff60 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "GET /compute/v2.1/servers/c79cac58-3818-4e93-adda-6cd824a32dca" status: 200 len: 1264 microversion: 2.1 time: 0.158430 Aug 09 07:21:45.103475 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 506/1010] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:21:44 2022] GET /compute/v2.1/servers/c79cac58-3818-4e93-adda-6cd824a32dca => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:21:46.123935 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-6ece05ba-2607-4c3f-a6b2-7ba416fdc69b tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:21:46.124333 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-6ece05ba-2607-4c3f-a6b2-7ba416fdc69b tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: c79cac58-3818-4e93-adda-6cd824a32dca] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:21:46.126162 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_cell0:SELECT=2 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:21:46.126820 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_cell0:SELECT=6 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:21:46.133120 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6ece05ba-2607-4c3f-a6b2-7ba416fdc69b tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:21:46.133606 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6ece05ba-2607-4c3f-a6b2-7ba416fdc69b tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:21:46.134335 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6ece05ba-2607-4c3f-a6b2-7ba416fdc69b tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:21:46.135036 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6ece05ba-2607-4c3f-a6b2-7ba416fdc69b tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:21:46.135490 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6ece05ba-2607-4c3f-a6b2-7ba416fdc69b tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:21:46.135934 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-6ece05ba-2607-4c3f-a6b2-7ba416fdc69b tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:21:46.265253 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-6ece05ba-2607-4c3f-a6b2-7ba416fdc69b tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc228ac26c454318b15e1a2f198ebdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f07b87ad643b58d21be9042b64c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:21:46.272736 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-6ece05ba-2607-4c3f-a6b2-7ba416fdc69b tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "GET /compute/v2.1/servers/c79cac58-3818-4e93-adda-6cd824a32dca" status: 200 len: 1264 microversion: 2.1 time: 0.153123 Aug 09 07:21:46.273289 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 505/1011] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:21:46 2022] GET /compute/v2.1/servers/c79cac58-3818-4e93-adda-6cd824a32dca => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:21:47.293878 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-0900f46b-e073-487e-b058-600e8b526e06 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:21:47.294486 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-0900f46b-e073-487e-b058-600e8b526e06 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: c79cac58-3818-4e93-adda-6cd824a32dca] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:21:47.301360 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0900f46b-e073-487e-b058-600e8b526e06 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:21:47.301932 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0900f46b-e073-487e-b058-600e8b526e06 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:21:47.302358 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0900f46b-e073-487e-b058-600e8b526e06 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:21:47.303037 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0900f46b-e073-487e-b058-600e8b526e06 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:21:47.303487 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0900f46b-e073-487e-b058-600e8b526e06 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:21:47.303928 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0900f46b-e073-487e-b058-600e8b526e06 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:21:47.433282 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-0900f46b-e073-487e-b058-600e8b526e06 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc228ac26c454318b15e1a2f198ebdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f07b87ad643b58d21be9042b64c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:21:47.440704 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-0900f46b-e073-487e-b058-600e8b526e06 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "GET /compute/v2.1/servers/c79cac58-3818-4e93-adda-6cd824a32dca" status: 200 len: 1264 microversion: 2.1 time: 0.150667 Aug 09 07:21:47.441895 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 507/1012] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:21:47 2022] GET /compute/v2.1/servers/c79cac58-3818-4e93-adda-6cd824a32dca => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:21:47.810672 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [req-d1370810-c303-4369-b790-3a810745966e req-b9dacec3-a7d5-4497-8572-da06d077f626 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c79cac58-3818-4e93-adda-6cd824a32dca", "name": "network-vif-plugged", "status": "completed", "tag": "22a341e9-50c5-49e7-be5e-88519cb1526a"}]} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:21:47.820640 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-d1370810-c303-4369-b790-3a810745966e req-b9dacec3-a7d5-4497-8572-da06d077f626 service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:21:47.821111 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-d1370810-c303-4369-b790-3a810745966e req-b9dacec3-a7d5-4497-8572-da06d077f626 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:21:47.821540 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-d1370810-c303-4369-b790-3a810745966e req-b9dacec3-a7d5-4497-8572-da06d077f626 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:21:47.833185 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.compute.server_external_events [req-d1370810-c303-4369-b790-3a810745966e req-b9dacec3-a7d5-4497-8572-da06d077f626 service nova] Creating event network-vif-plugged:22a341e9-50c5-49e7-be5e-88519cb1526a for instance c79cac58-3818-4e93-adda-6cd824a32dca on hv-cinder-85251 Aug 09 07:21:47.842344 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [req-d1370810-c303-4369-b790-3a810745966e req-b9dacec3-a7d5-4497-8572-da06d077f626 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104305 Aug 09 07:21:47.842958 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 506/1013] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 07:21:48.461671 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a263259c-3383-4eba-aee6-c10568429687 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:21:48.462273 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-a263259c-3383-4eba-aee6-c10568429687 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: c79cac58-3818-4e93-adda-6cd824a32dca] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:21:48.468750 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a263259c-3383-4eba-aee6-c10568429687 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:21:48.469230 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a263259c-3383-4eba-aee6-c10568429687 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:21:48.469664 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a263259c-3383-4eba-aee6-c10568429687 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:21:48.470352 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a263259c-3383-4eba-aee6-c10568429687 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:21:48.470804 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a263259c-3383-4eba-aee6-c10568429687 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:21:48.471231 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a263259c-3383-4eba-aee6-c10568429687 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:21:48.604672 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-a263259c-3383-4eba-aee6-c10568429687 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc228ac26c454318b15e1a2f198ebdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f07b87ad643b58d21be9042b64c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:21:48.612109 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-a263259c-3383-4eba-aee6-c10568429687 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "GET /compute/v2.1/servers/c79cac58-3818-4e93-adda-6cd824a32dca" status: 200 len: 1264 microversion: 2.1 time: 0.154343 Aug 09 07:21:48.612673 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 508/1014] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:21:48 2022] GET /compute/v2.1/servers/c79cac58-3818-4e93-adda-6cd824a32dca => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:21:49.633442 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-0374650d-3e72-4632-be74-1321710530e3 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:21:49.634434 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-0374650d-3e72-4632-be74-1321710530e3 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: c79cac58-3818-4e93-adda-6cd824a32dca] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:21:49.640602 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0374650d-3e72-4632-be74-1321710530e3 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:21:49.641085 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0374650d-3e72-4632-be74-1321710530e3 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:21:49.641521 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0374650d-3e72-4632-be74-1321710530e3 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:21:49.642209 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0374650d-3e72-4632-be74-1321710530e3 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:21:49.642659 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0374650d-3e72-4632-be74-1321710530e3 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:21:49.643081 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-0374650d-3e72-4632-be74-1321710530e3 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:21:49.775615 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-0374650d-3e72-4632-be74-1321710530e3 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc228ac26c454318b15e1a2f198ebdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f07b87ad643b58d21be9042b64c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:21:49.783097 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-0374650d-3e72-4632-be74-1321710530e3 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "GET /compute/v2.1/servers/c79cac58-3818-4e93-adda-6cd824a32dca" status: 200 len: 1452 microversion: 2.1 time: 0.154919 Aug 09 07:21:49.783669 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 507/1015] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:21:49 2022] GET /compute/v2.1/servers/c79cac58-3818-4e93-adda-6cd824a32dca => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:21:49.804175 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-9c06782b-17c4-441b-a78a-53fc5920793d tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:21:49.804797 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-9c06782b-17c4-441b-a78a-53fc5920793d tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: c79cac58-3818-4e93-adda-6cd824a32dca] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:21:49.811150 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9c06782b-17c4-441b-a78a-53fc5920793d tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:21:49.811660 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9c06782b-17c4-441b-a78a-53fc5920793d tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:21:49.812124 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9c06782b-17c4-441b-a78a-53fc5920793d tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:21:49.812813 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9c06782b-17c4-441b-a78a-53fc5920793d tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:21:49.813274 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9c06782b-17c4-441b-a78a-53fc5920793d tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:21:49.813693 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9c06782b-17c4-441b-a78a-53fc5920793d tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:21:49.945781 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-9c06782b-17c4-441b-a78a-53fc5920793d tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc228ac26c454318b15e1a2f198ebdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f07b87ad643b58d21be9042b64c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:21:49.953318 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-9c06782b-17c4-441b-a78a-53fc5920793d tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "GET /compute/v2.1/servers/c79cac58-3818-4e93-adda-6cd824a32dca" status: 200 len: 1452 microversion: 2.1 time: 0.153898 Aug 09 07:21:49.953887 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 509/1016] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:21:49 2022] GET /compute/v2.1/servers/c79cac58-3818-4e93-adda-6cd824a32dca => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:21:51.580655 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [req-5653114b-5b08-4b5b-a2e1-9c1e84b81634 req-8e84f5c2-ec08-4708-8b8e-9a7bf4ab8daf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c79cac58-3818-4e93-adda-6cd824a32dca", "tag": "22a341e9-50c5-49e7-be5e-88519cb1526a"}]} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:21:51.590725 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-5653114b-5b08-4b5b-a2e1-9c1e84b81634 req-8e84f5c2-ec08-4708-8b8e-9a7bf4ab8daf service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:21:51.591198 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-5653114b-5b08-4b5b-a2e1-9c1e84b81634 req-8e84f5c2-ec08-4708-8b8e-9a7bf4ab8daf service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:21:51.591645 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-5653114b-5b08-4b5b-a2e1-9c1e84b81634 req-8e84f5c2-ec08-4708-8b8e-9a7bf4ab8daf service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:21:51.602920 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.compute.server_external_events [req-5653114b-5b08-4b5b-a2e1-9c1e84b81634 req-8e84f5c2-ec08-4708-8b8e-9a7bf4ab8daf service nova] Creating event network-changed:22a341e9-50c5-49e7-be5e-88519cb1526a for instance c79cac58-3818-4e93-adda-6cd824a32dca on hv-cinder-85251 Aug 09 07:21:51.607834 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [req-5653114b-5b08-4b5b-a2e1-9c1e84b81634 req-8e84f5c2-ec08-4708-8b8e-9a7bf4ab8daf service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084944 Aug 09 07:21:51.608409 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 508/1017] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:22:30.998326 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 07:22:30.998975 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Tue Aug 9 07:22:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 07:22:40.482904 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 07:22:40.483548 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Tue Aug 9 07:22:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 07:22:56.165530 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 07:22:56.166127 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Tue Aug 9 07:22:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 07:23:05.487730 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 07:23:05.488327 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Tue Aug 9 07:23:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 07:23:19.553184 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=20 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:23:19.554582 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=48 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:23:19.558281 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:23:19.558883 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4436c3b9-bbf5-4d7c-86c9-3731e2c8108e tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:23:19.559390 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4436c3b9-bbf5-4d7c-86c9-3731e2c8108e tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: c79cac58-3818-4e93-adda-6cd824a32dca] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:23:19.559939 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG dbcounter [-] [117858] Writing DB stats nova_cell1:SELECT=44 {{(pid=117858) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 09 07:23:19.565278 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [req-7b13ee5e-26d2-459b-bbec-43bc73dea626 req-6eb32a10-f375-4bce-a45a-c6916f63f8fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c79cac58-3818-4e93-adda-6cd824a32dca", "tag": "22a341e9-50c5-49e7-be5e-88519cb1526a"}]} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:23:19.566244 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4436c3b9-bbf5-4d7c-86c9-3731e2c8108e tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:23:19.566731 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4436c3b9-bbf5-4d7c-86c9-3731e2c8108e tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:23:19.567169 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4436c3b9-bbf5-4d7c-86c9-3731e2c8108e tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:23:19.567893 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4436c3b9-bbf5-4d7c-86c9-3731e2c8108e tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:23:19.568347 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4436c3b9-bbf5-4d7c-86c9-3731e2c8108e tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:23:19.568769 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4436c3b9-bbf5-4d7c-86c9-3731e2c8108e tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:23:19.576472 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-7b13ee5e-26d2-459b-bbec-43bc73dea626 req-6eb32a10-f375-4bce-a45a-c6916f63f8fb service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:23:19.577310 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-7b13ee5e-26d2-459b-bbec-43bc73dea626 req-6eb32a10-f375-4bce-a45a-c6916f63f8fb service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:23:19.578005 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-7b13ee5e-26d2-459b-bbec-43bc73dea626 req-6eb32a10-f375-4bce-a45a-c6916f63f8fb service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:23:19.590836 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.compute.server_external_events [req-7b13ee5e-26d2-459b-bbec-43bc73dea626 req-6eb32a10-f375-4bce-a45a-c6916f63f8fb service nova] Creating event network-changed:22a341e9-50c5-49e7-be5e-88519cb1526a for instance c79cac58-3818-4e93-adda-6cd824a32dca on hv-cinder-85251 Aug 09 07:23:19.598110 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [req-7b13ee5e-26d2-459b-bbec-43bc73dea626 req-6eb32a10-f375-4bce-a45a-c6916f63f8fb service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042652 Aug 09 07:23:19.598328 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4436c3b9-bbf5-4d7c-86c9-3731e2c8108e tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: c79cac58-3818-4e93-adda-6cd824a32dca] Going to try to terminate instance {{(pid=117859) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 07:23:19.598781 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 509/1018] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:23:19.692749 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4436c3b9-bbf5-4d7c-86c9-3731e2c8108e tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "DELETE /compute/v2.1/servers/c79cac58-3818-4e93-adda-6cd824a32dca" status: 204 len: 0 microversion: 2.1 time: 0.141198 Aug 09 07:23:19.693686 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 510/1019] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 9 07:23:19 2022] DELETE /compute/v2.1/servers/c79cac58-3818-4e93-adda-6cd824a32dca => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 09 07:23:19.703265 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-98dc6e93-a3eb-4a46-b516-9f45dfb01652 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:23:19.703993 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-98dc6e93-a3eb-4a46-b516-9f45dfb01652 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: c79cac58-3818-4e93-adda-6cd824a32dca] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:23:19.711702 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-98dc6e93-a3eb-4a46-b516-9f45dfb01652 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:23:19.712194 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-98dc6e93-a3eb-4a46-b516-9f45dfb01652 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:23:19.712625 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-98dc6e93-a3eb-4a46-b516-9f45dfb01652 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:23:19.713555 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-98dc6e93-a3eb-4a46-b516-9f45dfb01652 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:23:19.714103 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-98dc6e93-a3eb-4a46-b516-9f45dfb01652 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:23:19.714773 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-98dc6e93-a3eb-4a46-b516-9f45dfb01652 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:23:19.851962 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-98dc6e93-a3eb-4a46-b516-9f45dfb01652 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc228ac26c454318b15e1a2f198ebdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f07b87ad643b58d21be9042b64c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:23:19.860572 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-98dc6e93-a3eb-4a46-b516-9f45dfb01652 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "GET /compute/v2.1/servers/c79cac58-3818-4e93-adda-6cd824a32dca" status: 200 len: 1576 microversion: 2.1 time: 0.161745 Aug 09 07:23:19.861601 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 510/1020] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:23:19 2022] GET /compute/v2.1/servers/c79cac58-3818-4e93-adda-6cd824a32dca => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:23:20.883687 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-5be1f5fe-c5c3-481c-84fe-01622a22a64c tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:23:20.884405 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-5be1f5fe-c5c3-481c-84fe-01622a22a64c tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: c79cac58-3818-4e93-adda-6cd824a32dca] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:23:20.891823 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5be1f5fe-c5c3-481c-84fe-01622a22a64c tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:23:20.892312 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5be1f5fe-c5c3-481c-84fe-01622a22a64c tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:23:20.892752 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5be1f5fe-c5c3-481c-84fe-01622a22a64c tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:23:20.893515 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5be1f5fe-c5c3-481c-84fe-01622a22a64c tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:23:20.893998 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5be1f5fe-c5c3-481c-84fe-01622a22a64c tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:23:20.894424 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5be1f5fe-c5c3-481c-84fe-01622a22a64c tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:23:21.034332 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-5be1f5fe-c5c3-481c-84fe-01622a22a64c tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc228ac26c454318b15e1a2f198ebdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f07b87ad643b58d21be9042b64c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:23:21.042473 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-5be1f5fe-c5c3-481c-84fe-01622a22a64c tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "GET /compute/v2.1/servers/c79cac58-3818-4e93-adda-6cd824a32dca" status: 200 len: 1576 microversion: 2.1 time: 0.164541 Aug 09 07:23:21.043037 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 511/1021] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:23:20 2022] GET /compute/v2.1/servers/c79cac58-3818-4e93-adda-6cd824a32dca => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:23:21.779070 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [req-14a6f4a1-d480-451a-96f3-303049e5d332 req-f1724c3a-f37a-4312-b57f-e73063467169 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c79cac58-3818-4e93-adda-6cd824a32dca", "name": "network-vif-deleted", "tag": "22a341e9-50c5-49e7-be5e-88519cb1526a"}]} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:23:21.788291 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-14a6f4a1-d480-451a-96f3-303049e5d332 req-f1724c3a-f37a-4312-b57f-e73063467169 service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:23:21.788768 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-14a6f4a1-d480-451a-96f3-303049e5d332 req-f1724c3a-f37a-4312-b57f-e73063467169 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:23:21.789192 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-14a6f4a1-d480-451a-96f3-303049e5d332 req-f1724c3a-f37a-4312-b57f-e73063467169 service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:23:21.799910 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.compute.server_external_events [req-14a6f4a1-d480-451a-96f3-303049e5d332 req-f1724c3a-f37a-4312-b57f-e73063467169 service nova] Creating event network-vif-deleted:22a341e9-50c5-49e7-be5e-88519cb1526a for instance c79cac58-3818-4e93-adda-6cd824a32dca on hv-cinder-85251 Aug 09 07:23:21.804715 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [req-14a6f4a1-d480-451a-96f3-303049e5d332 req-f1724c3a-f37a-4312-b57f-e73063467169 service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114079 Aug 09 07:23:21.805293 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 511/1022] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:23:22.064100 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-8df542d9-0c07-4f12-8c67-54a607f4c856 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:23:22.064922 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-8df542d9-0c07-4f12-8c67-54a607f4c856 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: c79cac58-3818-4e93-adda-6cd824a32dca] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:23:22.072223 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8df542d9-0c07-4f12-8c67-54a607f4c856 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:23:22.072765 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8df542d9-0c07-4f12-8c67-54a607f4c856 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:23:22.073217 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8df542d9-0c07-4f12-8c67-54a607f4c856 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:23:22.073988 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8df542d9-0c07-4f12-8c67-54a607f4c856 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:23:22.074643 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8df542d9-0c07-4f12-8c67-54a607f4c856 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:23:22.075072 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8df542d9-0c07-4f12-8c67-54a607f4c856 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:23:22.109515 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8df542d9-0c07-4f12-8c67-54a607f4c856 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:23:22.110015 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8df542d9-0c07-4f12-8c67-54a607f4c856 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:23:22.110446 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8df542d9-0c07-4f12-8c67-54a607f4c856 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:23:22.110893 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.objects.instance [None req-8df542d9-0c07-4f12-8c67-54a607f4c856 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lazy-loading 'fault' on Instance uuid c79cac58-3818-4e93-adda-6cd824a32dca {{(pid=117859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 07:23:22.152360 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8df542d9-0c07-4f12-8c67-54a607f4c856 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc228ac26c454318b15e1a2f198ebdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f07b87ad643b58d21be9042b64c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:23:22.159780 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-8df542d9-0c07-4f12-8c67-54a607f4c856 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "GET /compute/v2.1/servers/c79cac58-3818-4e93-adda-6cd824a32dca" status: 200 len: 1228 microversion: 2.1 time: 0.099731 Aug 09 07:23:22.160342 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 512/1023] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:23:22 2022] GET /compute/v2.1/servers/c79cac58-3818-4e93-adda-6cd824a32dca => generated 1228 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:23:23.181205 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-e2c7d1f1-9024-4fc8-a18d-868ae0a10658 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:23:23.181905 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-e2c7d1f1-9024-4fc8-a18d-868ae0a10658 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: c79cac58-3818-4e93-adda-6cd824a32dca] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:23:23.188506 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e2c7d1f1-9024-4fc8-a18d-868ae0a10658 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:23:23.188991 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e2c7d1f1-9024-4fc8-a18d-868ae0a10658 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:23:23.189426 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e2c7d1f1-9024-4fc8-a18d-868ae0a10658 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:23:23.190114 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e2c7d1f1-9024-4fc8-a18d-868ae0a10658 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:23:23.190564 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e2c7d1f1-9024-4fc8-a18d-868ae0a10658 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:23:23.190987 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-e2c7d1f1-9024-4fc8-a18d-868ae0a10658 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:23:23.204848 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.wsgi [None req-e2c7d1f1-9024-4fc8-a18d-868ae0a10658 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] HTTP exception thrown: Instance c79cac58-3818-4e93-adda-6cd824a32dca could not be found. Aug 09 07:23:23.206852 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-e2c7d1f1-9024-4fc8-a18d-868ae0a10658 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Request method failure captured: Aug 09 07:23:23.206852 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: request: GET /compute/v2.1/servers/c79cac58-3818-4e93-adda-6cd824a32dca HTTP/1.1 Aug 09 07:23:23.206852 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Accept: application/json Aug 09 07:23:23.206852 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Accept-Encoding: identity Aug 09 07:23:23.206852 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Connection: close Aug 09 07:23:23.206852 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Content-Length: 0 Aug 09 07:23:23.206852 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Content-Type: application/json Aug 09 07:23:23.206852 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Host: 10.222.0.30 Aug 09 07:23:23.206852 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Openstack-System-Scope: None Aug 09 07:23:23.206852 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: User-Agent: python-urllib3/1.26.11 Aug 09 07:23:23.206852 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Auth-Token: gAAAAABi8gnvg8JDG_B6ue6tyPjxvTN8FthbXragKGXJf2rs8bibfgy1wxkjza7BgRBbgHtx2fAUNW0nDhnjHvWNZHg6ZGsTOpybjf8GXol81veOwYQaBQ1aAnO8xDOIcICyhKDsUlX6EaLDzIaop7Y5uZ6f7fhR7PWBYBdYUEhGONPLK80UcI8 Aug 09 07:23:23.206852 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Domain-Id: None Aug 09 07:23:23.206852 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Domain-Name: None Aug 09 07:23:23.206852 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Identity-Status: Confirmed Aug 09 07:23:23.206852 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Is-Admin-Project: True Aug 09 07:23:23.206852 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Domain-Id: default Aug 09 07:23:23.206852 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Domain-Name: Default Aug 09 07:23:23.206852 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Id: ac9f07b87ad643b58d21be9042b64c87 Aug 09 07:23:23.206852 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Name: tempest-TestVolumeBootPattern-2044081928 Aug 09 07:23:23.206852 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Role: reader,member Aug 09 07:23:23.206852 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Roles: reader,member Aug 09 07:23:23.208660 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ac9f07b87ad643b58d21be9042b64c87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ac9f07b87ad643b58d21be9042b64c87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ac9f07b87ad643b58d21be9042b64c87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ac9f07b87ad643b58d21be9042b64c87"}]}] Aug 09 07:23:23.208660 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant: tempest-TestVolumeBootPattern-2044081928 Aug 09 07:23:23.208660 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant-Id: ac9f07b87ad643b58d21be9042b64c87 Aug 09 07:23:23.208660 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant-Name: tempest-TestVolumeBootPattern-2044081928 Aug 09 07:23:23.208660 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User: tempest-TestVolumeBootPattern-2044081928-project Aug 09 07:23:23.208660 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Domain-Id: default Aug 09 07:23:23.208660 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Domain-Name: Default Aug 09 07:23:23.208660 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Id: cc228ac26c454318b15e1a2f198ebdf4 Aug 09 07:23:23.208660 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Name: tempest-TestVolumeBootPattern-2044081928-project Aug 09 07:23:23.208660 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: method: > Aug 09 07:23:23.208660 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: exception: Instance c79cac58-3818-4e93-adda-6cd824a32dca could not be found. Aug 09 07:23:23.208660 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: action_args: {'id': 'c79cac58-3818-4e93-adda-6cd824a32dca'} Aug 09 07:23:23.210343 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 07:23:23.210343 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:23:23.210343 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 07:23:23.210343 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 07:23:23.210343 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 07:23:23.210343 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 07:23:23.210343 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 07:23:23.210343 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 07:23:23.210343 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 07:23:23.210343 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 07:23:23.210343 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c79cac58-3818-4e93-adda-6cd824a32dca could not be found. Aug 09 07:23:23.210343 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:23:23.210343 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:23:23.210343 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:23:23.210343 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:23:23.210343 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:23:23.210343 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:23:23.210343 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 07:23:23.210343 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 07:23:23.210343 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 07:23:23.212128 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 07:23:23.212128 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 07:23:23.212128 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 07:23:23.212128 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 07:23:23.212128 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 07:23:23.212128 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 07:23:23.212128 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 07:23:23.212128 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c79cac58-3818-4e93-adda-6cd824a32dca could not be found. Aug 09 07:23:23.212128 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:23:23.212128 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:23:23.212128 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:23:23.212128 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:23:23.212128 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:23:23.212128 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:23:23.212128 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 07:23:23.212128 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 07:23:23.212128 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c79cac58-3818-4e93-adda-6cd824a32dca could not be found. Aug 09 07:23:23.212128 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:23:23.213773 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-e2c7d1f1-9024-4fc8-a18d-868ae0a10658 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Returning 404 to user: Instance c79cac58-3818-4e93-adda-6cd824a32dca could not be found. {{(pid=117858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 07:23:23.213773 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-e2c7d1f1-9024-4fc8-a18d-868ae0a10658 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "GET /compute/v2.1/servers/c79cac58-3818-4e93-adda-6cd824a32dca" status: 404 len: 111 microversion: 2.1 time: 0.031534 Aug 09 07:23:23.213773 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 512/1024] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:23:23 2022] GET /compute/v2.1/servers/c79cac58-3818-4e93-adda-6cd824a32dca => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 07:23:26.267773 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-281543d0-b771-4135-a671-da84977320ff tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:23:26.268298 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-281543d0-b771-4135-a671-da84977320ff tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: ccb8da13-c579-4817-b66a-0db21be4b276] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:23:26.270217 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [req-7c80588c-99b4-424c-a530-ea8bf2596e94 req-1eaf00a8-a1a8-4fa9-9a31-e15def8ee77b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccb8da13-c579-4817-b66a-0db21be4b276", "tag": "d47cb641-9106-43c3-a6c5-1f214fa55441"}]} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:23:26.275422 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-281543d0-b771-4135-a671-da84977320ff tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:23:26.275932 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-281543d0-b771-4135-a671-da84977320ff tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:23:26.276576 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-281543d0-b771-4135-a671-da84977320ff tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:23:26.277266 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-281543d0-b771-4135-a671-da84977320ff tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:23:26.277712 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-281543d0-b771-4135-a671-da84977320ff tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:23:26.278304 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-281543d0-b771-4135-a671-da84977320ff tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:23:26.281546 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-7c80588c-99b4-424c-a530-ea8bf2596e94 req-1eaf00a8-a1a8-4fa9-9a31-e15def8ee77b service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:23:26.282127 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-7c80588c-99b4-424c-a530-ea8bf2596e94 req-1eaf00a8-a1a8-4fa9-9a31-e15def8ee77b service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:23:26.282793 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-7c80588c-99b4-424c-a530-ea8bf2596e94 req-1eaf00a8-a1a8-4fa9-9a31-e15def8ee77b service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:23:26.294982 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.compute.server_external_events [req-7c80588c-99b4-424c-a530-ea8bf2596e94 req-1eaf00a8-a1a8-4fa9-9a31-e15def8ee77b service nova] Creating event network-changed:d47cb641-9106-43c3-a6c5-1f214fa55441 for instance ccb8da13-c579-4817-b66a-0db21be4b276 on hv-cinder-85251 Aug 09 07:23:26.300849 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [req-7c80588c-99b4-424c-a530-ea8bf2596e94 req-1eaf00a8-a1a8-4fa9-9a31-e15def8ee77b service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034333 Aug 09 07:23:26.301444 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 513/1025] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 09 07:23:26.305589 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-281543d0-b771-4135-a671-da84977320ff tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: ccb8da13-c579-4817-b66a-0db21be4b276] Going to try to terminate instance {{(pid=117859) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 09 07:23:26.391057 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-281543d0-b771-4135-a671-da84977320ff tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "DELETE /compute/v2.1/servers/ccb8da13-c579-4817-b66a-0db21be4b276" status: 204 len: 0 microversion: 2.1 time: 0.126833 Aug 09 07:23:26.392444 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 513/1026] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 9 07:23:26 2022] DELETE /compute/v2.1/servers/ccb8da13-c579-4817-b66a-0db21be4b276 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 09 07:23:26.402461 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-18b9bfb7-8d28-4953-b8e5-1a26e536efd4 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:23:26.403624 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-18b9bfb7-8d28-4953-b8e5-1a26e536efd4 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: ccb8da13-c579-4817-b66a-0db21be4b276] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:23:26.410055 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-18b9bfb7-8d28-4953-b8e5-1a26e536efd4 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:23:26.410662 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-18b9bfb7-8d28-4953-b8e5-1a26e536efd4 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:23:26.411193 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-18b9bfb7-8d28-4953-b8e5-1a26e536efd4 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:23:26.412068 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-18b9bfb7-8d28-4953-b8e5-1a26e536efd4 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:23:26.412673 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-18b9bfb7-8d28-4953-b8e5-1a26e536efd4 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:23:26.413524 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-18b9bfb7-8d28-4953-b8e5-1a26e536efd4 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:23:26.550618 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.policy [None req-18b9bfb7-8d28-4953-b8e5-1a26e536efd4 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc228ac26c454318b15e1a2f198ebdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f07b87ad643b58d21be9042b64c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117858) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:23:26.559114 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-18b9bfb7-8d28-4953-b8e5-1a26e536efd4 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "GET /compute/v2.1/servers/ccb8da13-c579-4817-b66a-0db21be4b276" status: 200 len: 1578 microversion: 2.1 time: 0.162038 Aug 09 07:23:26.559630 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 514/1027] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:23:26 2022] GET /compute/v2.1/servers/ccb8da13-c579-4817-b66a-0db21be4b276 => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:23:27.581292 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-8dd18009-d2aa-4ce3-bca1-d8522c2c336e tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:23:27.581989 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-8dd18009-d2aa-4ce3-bca1-d8522c2c336e tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: ccb8da13-c579-4817-b66a-0db21be4b276] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:23:27.588996 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8dd18009-d2aa-4ce3-bca1-d8522c2c336e tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:23:27.589476 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8dd18009-d2aa-4ce3-bca1-d8522c2c336e tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:23:27.589915 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8dd18009-d2aa-4ce3-bca1-d8522c2c336e tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:23:27.590612 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8dd18009-d2aa-4ce3-bca1-d8522c2c336e tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:23:27.591066 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8dd18009-d2aa-4ce3-bca1-d8522c2c336e tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:23:27.591490 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8dd18009-d2aa-4ce3-bca1-d8522c2c336e tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:23:27.727001 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8dd18009-d2aa-4ce3-bca1-d8522c2c336e tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc228ac26c454318b15e1a2f198ebdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f07b87ad643b58d21be9042b64c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:23:27.734561 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-8dd18009-d2aa-4ce3-bca1-d8522c2c336e tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "GET /compute/v2.1/servers/ccb8da13-c579-4817-b66a-0db21be4b276" status: 200 len: 1578 microversion: 2.1 time: 0.157470 Aug 09 07:23:27.735124 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 514/1028] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:23:27 2022] GET /compute/v2.1/servers/ccb8da13-c579-4817-b66a-0db21be4b276 => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:23:28.331940 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [req-7a6e803b-5f17-4328-9eb7-7cd48756b69c req-9909a3c1-8c1c-48ab-bc31-649a0e96c7ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccb8da13-c579-4817-b66a-0db21be4b276", "name": "network-vif-deleted", "tag": "d47cb641-9106-43c3-a6c5-1f214fa55441"}]} {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 09 07:23:28.342650 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-7a6e803b-5f17-4328-9eb7-7cd48756b69c req-9909a3c1-8c1c-48ab-bc31-649a0e96c7ba service nova] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:23:28.343130 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-7a6e803b-5f17-4328-9eb7-7cd48756b69c req-9909a3c1-8c1c-48ab-bc31-649a0e96c7ba service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:23:28.343561 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [req-7a6e803b-5f17-4328-9eb7-7cd48756b69c req-9909a3c1-8c1c-48ab-bc31-649a0e96c7ba service nova] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:23:28.355315 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.compute.server_external_events [req-7a6e803b-5f17-4328-9eb7-7cd48756b69c req-9909a3c1-8c1c-48ab-bc31-649a0e96c7ba service nova] Creating event network-vif-deleted:d47cb641-9106-43c3-a6c5-1f214fa55441 for instance ccb8da13-c579-4817-b66a-0db21be4b276 on hv-cinder-85251 Aug 09 07:23:28.360021 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [req-7a6e803b-5f17-4328-9eb7-7cd48756b69c req-9909a3c1-8c1c-48ab-bc31-649a0e96c7ba service nova] 10.222.0.30 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031817 Aug 09 07:23:28.360597 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 515/1029] 10.222.0.30 () {64 vars in 1317 bytes} [Tue Aug 9 07:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 09 07:23:28.755727 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6805d14d-8f46-432e-b201-035a43c87b90 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:23:28.756391 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-6805d14d-8f46-432e-b201-035a43c87b90 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: ccb8da13-c579-4817-b66a-0db21be4b276] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:23:28.763286 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6805d14d-8f46-432e-b201-035a43c87b90 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:23:28.763818 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6805d14d-8f46-432e-b201-035a43c87b90 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:23:28.764257 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6805d14d-8f46-432e-b201-035a43c87b90 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:23:28.764963 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6805d14d-8f46-432e-b201-035a43c87b90 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:23:28.765423 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6805d14d-8f46-432e-b201-035a43c87b90 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:23:28.765850 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6805d14d-8f46-432e-b201-035a43c87b90 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:23:28.799129 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6805d14d-8f46-432e-b201-035a43c87b90 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:23:28.799532 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6805d14d-8f46-432e-b201-035a43c87b90 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:23:28.799998 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6805d14d-8f46-432e-b201-035a43c87b90 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:23:28.800443 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.objects.instance [None req-6805d14d-8f46-432e-b201-035a43c87b90 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lazy-loading 'fault' on Instance uuid ccb8da13-c579-4817-b66a-0db21be4b276 {{(pid=117859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 09 07:23:28.842814 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6805d14d-8f46-432e-b201-035a43c87b90 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc228ac26c454318b15e1a2f198ebdf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9f07b87ad643b58d21be9042b64c87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 09 07:23:28.850992 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-6805d14d-8f46-432e-b201-035a43c87b90 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "GET /compute/v2.1/servers/ccb8da13-c579-4817-b66a-0db21be4b276" status: 200 len: 1229 microversion: 2.1 time: 0.098941 Aug 09 07:23:28.851576 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 515/1030] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:23:28 2022] GET /compute/v2.1/servers/ccb8da13-c579-4817-b66a-0db21be4b276 => generated 1229 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 09 07:23:29.873775 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-89c9b9b2-2fda-4e93-a8c7-820374113e49 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:23:29.874473 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-89c9b9b2-2fda-4e93-a8c7-820374113e49 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: ccb8da13-c579-4817-b66a-0db21be4b276] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:23:29.880594 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-89c9b9b2-2fda-4e93-a8c7-820374113e49 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:23:29.881075 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-89c9b9b2-2fda-4e93-a8c7-820374113e49 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:23:29.882003 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-89c9b9b2-2fda-4e93-a8c7-820374113e49 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:23:29.882688 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-89c9b9b2-2fda-4e93-a8c7-820374113e49 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:23:29.883141 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-89c9b9b2-2fda-4e93-a8c7-820374113e49 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:23:29.883566 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-89c9b9b2-2fda-4e93-a8c7-820374113e49 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:23:29.896885 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.wsgi [None req-89c9b9b2-2fda-4e93-a8c7-820374113e49 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] HTTP exception thrown: Instance ccb8da13-c579-4817-b66a-0db21be4b276 could not be found. Aug 09 07:23:29.899038 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-89c9b9b2-2fda-4e93-a8c7-820374113e49 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Request method failure captured: Aug 09 07:23:29.899038 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: request: GET /compute/v2.1/servers/ccb8da13-c579-4817-b66a-0db21be4b276 HTTP/1.1 Aug 09 07:23:29.899038 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Accept: application/json Aug 09 07:23:29.899038 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Accept-Encoding: identity Aug 09 07:23:29.899038 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Connection: close Aug 09 07:23:29.899038 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Content-Length: 0 Aug 09 07:23:29.899038 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Content-Type: application/json Aug 09 07:23:29.899038 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Host: 10.222.0.30 Aug 09 07:23:29.899038 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Openstack-System-Scope: None Aug 09 07:23:29.899038 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: User-Agent: python-urllib3/1.26.11 Aug 09 07:23:29.899038 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Auth-Token: gAAAAABi8gnvg8JDG_B6ue6tyPjxvTN8FthbXragKGXJf2rs8bibfgy1wxkjza7BgRBbgHtx2fAUNW0nDhnjHvWNZHg6ZGsTOpybjf8GXol81veOwYQaBQ1aAnO8xDOIcICyhKDsUlX6EaLDzIaop7Y5uZ6f7fhR7PWBYBdYUEhGONPLK80UcI8 Aug 09 07:23:29.899038 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Domain-Id: None Aug 09 07:23:29.899038 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Domain-Name: None Aug 09 07:23:29.899038 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Identity-Status: Confirmed Aug 09 07:23:29.899038 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Is-Admin-Project: True Aug 09 07:23:29.899038 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Domain-Id: default Aug 09 07:23:29.899038 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Domain-Name: Default Aug 09 07:23:29.899038 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Id: ac9f07b87ad643b58d21be9042b64c87 Aug 09 07:23:29.899038 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Name: tempest-TestVolumeBootPattern-2044081928 Aug 09 07:23:29.899038 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Role: reader,member Aug 09 07:23:29.899038 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Roles: reader,member Aug 09 07:23:29.900633 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ac9f07b87ad643b58d21be9042b64c87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ac9f07b87ad643b58d21be9042b64c87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ac9f07b87ad643b58d21be9042b64c87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ac9f07b87ad643b58d21be9042b64c87"}]}] Aug 09 07:23:29.900633 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant: tempest-TestVolumeBootPattern-2044081928 Aug 09 07:23:29.900633 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant-Id: ac9f07b87ad643b58d21be9042b64c87 Aug 09 07:23:29.900633 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant-Name: tempest-TestVolumeBootPattern-2044081928 Aug 09 07:23:29.900633 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User: tempest-TestVolumeBootPattern-2044081928-project Aug 09 07:23:29.900633 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Domain-Id: default Aug 09 07:23:29.900633 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Domain-Name: Default Aug 09 07:23:29.900633 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Id: cc228ac26c454318b15e1a2f198ebdf4 Aug 09 07:23:29.900633 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Name: tempest-TestVolumeBootPattern-2044081928-project Aug 09 07:23:29.900633 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: method: > Aug 09 07:23:29.900633 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: exception: Instance ccb8da13-c579-4817-b66a-0db21be4b276 could not be found. Aug 09 07:23:29.900633 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: action_args: {'id': 'ccb8da13-c579-4817-b66a-0db21be4b276'} Aug 09 07:23:29.901499 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 07:23:29.901499 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:23:29.901499 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 07:23:29.901499 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 07:23:29.901499 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 07:23:29.901499 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 07:23:29.901499 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 07:23:29.901499 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 07:23:29.901499 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 07:23:29.901499 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 07:23:29.901499 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccb8da13-c579-4817-b66a-0db21be4b276 could not be found. Aug 09 07:23:29.901499 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:23:29.901499 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:23:29.901499 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:23:29.901499 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:23:29.901499 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:23:29.901499 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:23:29.901499 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 07:23:29.901499 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 07:23:29.901499 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 07:23:29.903066 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 07:23:29.903066 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 07:23:29.903066 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 07:23:29.903066 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 07:23:29.903066 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 07:23:29.903066 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 07:23:29.903066 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 07:23:29.903066 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccb8da13-c579-4817-b66a-0db21be4b276 could not be found. Aug 09 07:23:29.903066 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:23:29.903066 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:23:29.903066 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:23:29.903066 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:23:29.903066 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:23:29.903066 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:23:29.903066 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 07:23:29.903066 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 07:23:29.903066 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccb8da13-c579-4817-b66a-0db21be4b276 could not be found. Aug 09 07:23:29.903066 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:23:29.904615 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-89c9b9b2-2fda-4e93-a8c7-820374113e49 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Returning 404 to user: Instance ccb8da13-c579-4817-b66a-0db21be4b276 could not be found. {{(pid=117858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 07:23:29.904615 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-89c9b9b2-2fda-4e93-a8c7-820374113e49 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "GET /compute/v2.1/servers/ccb8da13-c579-4817-b66a-0db21be4b276" status: 404 len: 111 microversion: 2.1 time: 0.031448 Aug 09 07:23:29.904615 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 516/1031] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:23:29 2022] GET /compute/v2.1/servers/ccb8da13-c579-4817-b66a-0db21be4b276 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 07:23:30.333135 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4ebf8532-1cfd-4978-b03f-9a677509b61a tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:23:30.333639 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4ebf8532-1cfd-4978-b03f-9a677509b61a tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: 1f2f5b4c-2968-48ca-8650-2479ce6055f3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:23:30.340176 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4ebf8532-1cfd-4978-b03f-9a677509b61a tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:23:30.340658 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4ebf8532-1cfd-4978-b03f-9a677509b61a tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:23:30.341096 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4ebf8532-1cfd-4978-b03f-9a677509b61a tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:23:30.341781 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4ebf8532-1cfd-4978-b03f-9a677509b61a tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:23:30.342237 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4ebf8532-1cfd-4978-b03f-9a677509b61a tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:23:30.342661 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4ebf8532-1cfd-4978-b03f-9a677509b61a tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:23:30.355861 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-4ebf8532-1cfd-4978-b03f-9a677509b61a tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] HTTP exception thrown: Instance 1f2f5b4c-2968-48ca-8650-2479ce6055f3 could not be found. Aug 09 07:23:30.357492 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4ebf8532-1cfd-4978-b03f-9a677509b61a tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Request method failure captured: Aug 09 07:23:30.357492 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: request: DELETE /compute/v2.1/servers/1f2f5b4c-2968-48ca-8650-2479ce6055f3 HTTP/1.1 Aug 09 07:23:30.357492 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 09 07:23:30.357492 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 09 07:23:30.357492 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Connection: close Aug 09 07:23:30.357492 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Length: 0 Aug 09 07:23:30.357492 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 09 07:23:30.357492 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.30 Aug 09 07:23:30.357492 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 09 07:23:30.357492 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.11 Aug 09 07:23:30.357492 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi8gnvg8JDG_B6ue6tyPjxvTN8FthbXragKGXJf2rs8bibfgy1wxkjza7BgRBbgHtx2fAUNW0nDhnjHvWNZHg6ZGsTOpybjf8GXol81veOwYQaBQ1aAnO8xDOIcICyhKDsUlX6EaLDzIaop7Y5uZ6f7fhR7PWBYBdYUEhGONPLK80UcI8 Aug 09 07:23:30.357492 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 09 07:23:30.357492 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 09 07:23:30.357492 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 09 07:23:30.357492 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 09 07:23:30.357492 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 09 07:23:30.357492 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 09 07:23:30.357492 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Id: ac9f07b87ad643b58d21be9042b64c87 Aug 09 07:23:30.357492 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-TestVolumeBootPattern-2044081928 Aug 09 07:23:30.357492 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 09 07:23:30.357492 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 09 07:23:30.359282 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ac9f07b87ad643b58d21be9042b64c87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ac9f07b87ad643b58d21be9042b64c87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ac9f07b87ad643b58d21be9042b64c87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ac9f07b87ad643b58d21be9042b64c87"}]}] Aug 09 07:23:30.359282 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-TestVolumeBootPattern-2044081928 Aug 09 07:23:30.359282 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: ac9f07b87ad643b58d21be9042b64c87 Aug 09 07:23:30.359282 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-TestVolumeBootPattern-2044081928 Aug 09 07:23:30.359282 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User: tempest-TestVolumeBootPattern-2044081928-project Aug 09 07:23:30.359282 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 09 07:23:30.359282 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 09 07:23:30.359282 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Id: cc228ac26c454318b15e1a2f198ebdf4 Aug 09 07:23:30.359282 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-TestVolumeBootPattern-2044081928-project Aug 09 07:23:30.359282 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: method: > Aug 09 07:23:30.359282 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: exception: Instance 1f2f5b4c-2968-48ca-8650-2479ce6055f3 could not be found. Aug 09 07:23:30.359282 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: action_args: {'id': '1f2f5b4c-2968-48ca-8650-2479ce6055f3'} Aug 09 07:23:30.360203 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 07:23:30.360203 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:23:30.360203 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 07:23:30.360203 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 07:23:30.360203 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 07:23:30.360203 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 07:23:30.360203 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 07:23:30.360203 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 07:23:30.360203 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 07:23:30.360203 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 07:23:30.360203 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f2f5b4c-2968-48ca-8650-2479ce6055f3 could not be found. Aug 09 07:23:30.360203 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:23:30.360203 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:23:30.360203 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:23:30.360203 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:23:30.360203 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:23:30.360203 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:23:30.360203 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 07:23:30.360203 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 07:23:30.360203 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 07:23:30.361762 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 07:23:30.361762 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 09 07:23:30.361762 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 09 07:23:30.361762 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 09 07:23:30.361762 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 09 07:23:30.361762 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 07:23:30.361762 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 07:23:30.361762 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 07:23:30.361762 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 07:23:30.361762 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f2f5b4c-2968-48ca-8650-2479ce6055f3 could not be found. Aug 09 07:23:30.361762 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:23:30.361762 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:23:30.361762 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:23:30.361762 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:23:30.361762 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:23:30.361762 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:23:30.361762 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 07:23:30.361762 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 07:23:30.361762 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f2f5b4c-2968-48ca-8650-2479ce6055f3 could not be found. Aug 09 07:23:30.361762 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 09 07:23:30.363440 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4ebf8532-1cfd-4978-b03f-9a677509b61a tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Returning 404 to user: Instance 1f2f5b4c-2968-48ca-8650-2479ce6055f3 could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 07:23:30.363440 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4ebf8532-1cfd-4978-b03f-9a677509b61a tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "DELETE /compute/v2.1/servers/1f2f5b4c-2968-48ca-8650-2479ce6055f3" status: 404 len: 111 microversion: 2.1 time: 0.029627 Aug 09 07:23:30.363440 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 516/1032] 10.222.0.30 () {58 vars in 1239 bytes} [Tue Aug 9 07:23:30 2022] DELETE /compute/v2.1/servers/1f2f5b4c-2968-48ca-8650-2479ce6055f3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 07:23:30.368157 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-4f7ceeda-0ae1-4d4f-9bb6-fa7ef91e7d63 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '>' {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:23:30.368762 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.compute.api [None req-4f7ceeda-0ae1-4d4f-9bb6-fa7ef91e7d63 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] [instance: 1f2f5b4c-2968-48ca-8650-2479ce6055f3] Fetching instance by UUID {{(pid=117858) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 09 07:23:30.374533 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4f7ceeda-0ae1-4d4f-9bb6-fa7ef91e7d63 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:23:30.375035 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4f7ceeda-0ae1-4d4f-9bb6-fa7ef91e7d63 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:23:30.375472 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4f7ceeda-0ae1-4d4f-9bb6-fa7ef91e7d63 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:23:30.376174 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4f7ceeda-0ae1-4d4f-9bb6-fa7ef91e7d63 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Acquiring lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 09 07:23:30.376622 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4f7ceeda-0ae1-4d4f-9bb6-fa7ef91e7d63 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 09 07:23:30.377040 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG oslo_concurrency.lockutils [None req-4f7ceeda-0ae1-4d4f-9bb6-fa7ef91e7d63 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Lock "82160e21-03c7-4992-b3b2-4a6a6de7b596" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117858) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 09 07:23:30.392669 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.wsgi [None req-4f7ceeda-0ae1-4d4f-9bb6-fa7ef91e7d63 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] HTTP exception thrown: Instance 1f2f5b4c-2968-48ca-8650-2479ce6055f3 could not be found. Aug 09 07:23:30.394147 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-4f7ceeda-0ae1-4d4f-9bb6-fa7ef91e7d63 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Request method failure captured: Aug 09 07:23:30.394147 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: request: GET /compute/v2.1/servers/1f2f5b4c-2968-48ca-8650-2479ce6055f3 HTTP/1.1 Aug 09 07:23:30.394147 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Accept: application/json Aug 09 07:23:30.394147 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Accept-Encoding: identity Aug 09 07:23:30.394147 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Connection: close Aug 09 07:23:30.394147 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Content-Length: 0 Aug 09 07:23:30.394147 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Content-Type: application/json Aug 09 07:23:30.394147 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Host: 10.222.0.30 Aug 09 07:23:30.394147 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Openstack-System-Scope: None Aug 09 07:23:30.394147 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: User-Agent: python-urllib3/1.26.11 Aug 09 07:23:30.394147 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Auth-Token: gAAAAABi8gnvg8JDG_B6ue6tyPjxvTN8FthbXragKGXJf2rs8bibfgy1wxkjza7BgRBbgHtx2fAUNW0nDhnjHvWNZHg6ZGsTOpybjf8GXol81veOwYQaBQ1aAnO8xDOIcICyhKDsUlX6EaLDzIaop7Y5uZ6f7fhR7PWBYBdYUEhGONPLK80UcI8 Aug 09 07:23:30.394147 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Domain-Id: None Aug 09 07:23:30.394147 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Domain-Name: None Aug 09 07:23:30.394147 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Identity-Status: Confirmed Aug 09 07:23:30.394147 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Is-Admin-Project: True Aug 09 07:23:30.394147 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Domain-Id: default Aug 09 07:23:30.394147 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Domain-Name: Default Aug 09 07:23:30.394147 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Id: ac9f07b87ad643b58d21be9042b64c87 Aug 09 07:23:30.394147 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Project-Name: tempest-TestVolumeBootPattern-2044081928 Aug 09 07:23:30.394147 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Role: reader,member Aug 09 07:23:30.394147 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Roles: reader,member Aug 09 07:23:30.395975 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ac9f07b87ad643b58d21be9042b64c87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.30:8080", "publicURL": "http://10.222.0.30:8080/v1/AUTH_ac9f07b87ad643b58d21be9042b64c87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/compute/v2/ac9f07b87ad643b58d21be9042b64c87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.30/volume/v3/ac9f07b87ad643b58d21be9042b64c87"}]}] Aug 09 07:23:30.395975 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant: tempest-TestVolumeBootPattern-2044081928 Aug 09 07:23:30.395975 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant-Id: ac9f07b87ad643b58d21be9042b64c87 Aug 09 07:23:30.395975 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-Tenant-Name: tempest-TestVolumeBootPattern-2044081928 Aug 09 07:23:30.395975 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User: tempest-TestVolumeBootPattern-2044081928-project Aug 09 07:23:30.395975 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Domain-Id: default Aug 09 07:23:30.395975 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Domain-Name: Default Aug 09 07:23:30.395975 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Id: cc228ac26c454318b15e1a2f198ebdf4 Aug 09 07:23:30.395975 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: X-User-Name: tempest-TestVolumeBootPattern-2044081928-project Aug 09 07:23:30.395975 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: method: > Aug 09 07:23:30.395975 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: exception: Instance 1f2f5b4c-2968-48ca-8650-2479ce6055f3 could not be found. Aug 09 07:23:30.395975 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: action_args: {'id': '1f2f5b4c-2968-48ca-8650-2479ce6055f3'} Aug 09 07:23:30.396938 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: {{(pid=117858) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 09 07:23:30.396938 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:23:30.396938 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 09 07:23:30.396938 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 09 07:23:30.396938 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 09 07:23:30.396938 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 09 07:23:30.396938 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 09 07:23:30.396938 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 09 07:23:30.396938 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 09 07:23:30.396938 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 09 07:23:30.396938 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f2f5b4c-2968-48ca-8650-2479ce6055f3 could not be found. Aug 09 07:23:30.396938 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:23:30.396938 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:23:30.396938 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:23:30.396938 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:23:30.396938 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:23:30.396938 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:23:30.396938 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 09 07:23:30.396938 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 09 07:23:30.396938 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 09 07:23:30.398524 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 09 07:23:30.398524 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 09 07:23:30.398524 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 09 07:23:30.398524 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 09 07:23:30.398524 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 09 07:23:30.398524 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 09 07:23:30.398524 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 09 07:23:30.398524 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f2f5b4c-2968-48ca-8650-2479ce6055f3 could not be found. Aug 09 07:23:30.398524 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:23:30.398524 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 09 07:23:30.398524 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:23:30.398524 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 09 07:23:30.398524 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 09 07:23:30.398524 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 09 07:23:30.398524 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 09 07:23:30.398524 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 09 07:23:30.398524 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f2f5b4c-2968-48ca-8650-2479ce6055f3 could not be found. Aug 09 07:23:30.398524 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: ERROR nova.api.openstack.wsgi Aug 09 07:23:30.400014 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: DEBUG nova.api.openstack.wsgi [None req-4f7ceeda-0ae1-4d4f-9bb6-fa7ef91e7d63 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Returning 404 to user: Instance 1f2f5b4c-2968-48ca-8650-2479ce6055f3 could not be found. {{(pid=117858) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 09 07:23:30.400014 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO nova.api.openstack.requestlog [None req-4f7ceeda-0ae1-4d4f-9bb6-fa7ef91e7d63 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "GET /compute/v2.1/servers/1f2f5b4c-2968-48ca-8650-2479ce6055f3" status: 404 len: 111 microversion: 2.1 time: 0.031946 Aug 09 07:23:30.400014 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: [pid: 117858|app: 0|req: 517/1033] 10.222.0.30 () {58 vars in 1236 bytes} [Tue Aug 9 07:23:30 2022] GET /compute/v2.1/servers/1f2f5b4c-2968-48ca-8650-2479ce6055f3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 09 07:23:31.689186 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-fbfb420c-408d-4e63-8b9d-8a169a7092f4 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] Calling method '.version_select at 0x7f20dd3b1160>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 09 07:23:31.721678 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-fbfb420c-408d-4e63-8b9d-8a169a7092f4 tempest-TestVolumeBootPattern-2044081928 tempest-TestVolumeBootPattern-2044081928-project] 10.222.0.30 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-35902457" status: 202 len: 0 microversion: 2.1 time: 0.036316 Aug 09 07:23:31.725926 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 517/1034] 10.222.0.30 () {58 vars in 1257 bytes} [Tue Aug 9 07:23:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-35902457 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 09 07:24:19.972805 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 07:24:19.973423 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Tue Aug 9 07:24:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 07:25:51.006614 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 07:25:51.007375 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Tue Aug 9 07:25:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 07:26:00.491191 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 07:26:00.491696 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Tue Aug 9 07:26:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 07:26:16.173042 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 07:26:16.173744 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Tue Aug 9 07:26:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 07:26:17.768395 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 07:26:17.769006 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Tue Aug 9 07:26:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 07:26:25.496164 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 07:26:25.496704 dv-cinder-852514-1-iscsi devstack@n-api.service[117859]: Tue Aug 9 07:26:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 09 07:27:39.981582 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 09 07:27:39.982155 dv-cinder-852514-1-iscsi devstack@n-api.service[117858]: Tue Aug 9 07:27:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!